-- Logs begin at Tue 2022-07-05 15:10:47 UTC, end at Tue 2022-07-05 16:34:06 UTC. -- Jul 05 15:58:33.780132 dv-cinder-848759-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 15:58:33.787578 dv-cinder-848759-1-smb devstack@keystone.service[80415]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 15:58:33 2022] *** Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: nodename: dv-cinder-848759-1-smb Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: machine: x86_64 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: clock source: unix Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: pcre jit disabled Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: detected number of CPU cores: 4 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: current working directory: / Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: detected binary path: /usr/bin/uwsgi-core Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: your processes number limit is 47680 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: your memory page size is 4096 bytes Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: detected max file descriptor number: 2048 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: lock engine: pthread robust mutexes Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: thunder lock: enabled Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 15:58:33.791896 dv-cinder-848759-1-smb devstack@keystone.service[80415]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 15:58:33.834347 dv-cinder-848759-1-smb devstack@keystone.service[80415]: Python main interpreter initialized at 0x561ef013a9c0 Jul 05 15:58:33.834347 dv-cinder-848759-1-smb devstack@keystone.service[80415]: python threads support enabled Jul 05 15:58:33.834347 dv-cinder-848759-1-smb devstack@keystone.service[80415]: your server socket listen backlog is limited to 100 connections Jul 05 15:58:33.834347 dv-cinder-848759-1-smb devstack@keystone.service[80415]: your mercy for graceful operations on workers is 90 seconds Jul 05 15:58:33.834700 dv-cinder-848759-1-smb devstack@keystone.service[80415]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 15:58:33.834773 dv-cinder-848759-1-smb devstack@keystone.service[80415]: *** Operational MODE: preforking *** Jul 05 15:58:33.835021 dv-cinder-848759-1-smb devstack@keystone.service[80415]: *** uWSGI is running in multiple interpreter mode *** Jul 05 15:58:33.835021 dv-cinder-848759-1-smb devstack@keystone.service[80415]: spawned uWSGI master process (pid: 80415) Jul 05 15:58:33.835242 dv-cinder-848759-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 05 15:58:33.835768 dv-cinder-848759-1-smb devstack@keystone.service[80415]: spawned uWSGI worker 1 (pid: 80423, cores: 1) Jul 05 15:58:33.836935 dv-cinder-848759-1-smb devstack@keystone.service[80415]: spawned uWSGI worker 2 (pid: 80424, cores: 1) Jul 05 15:58:33.836935 dv-cinder-848759-1-smb devstack@keystone.service[80415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 15:58:39.156928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 15:58:39.156928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes Jul 05 15:58:39.157832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 15:58:39.157832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Jul 05 15:58:39.158237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 15:58:39.158237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: from cryptography.utils import int_from_bytes Jul 05 15:58:39.158334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 15:58:39.158334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Jul 05 15:58:39.205807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 15:58:39.206028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 15:58:39.206106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 15:58:39.206193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 15:58:39.206272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] command line args: [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 15:58:39.206348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] command line args: [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 15:58:39.206512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 15:58:39.206645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 15:58:39.206724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ================================================================================ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 15:58:39.206802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ================================================================================ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 15:58:39.206991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] config_dir = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] config_dir = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] config_source = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] config_source = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] debug = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] debug = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.207930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.208551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.208648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.208710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.208848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_config_append = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.209893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_config_append = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_dir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_dir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.210909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.211895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.212981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.213715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] publish_errors = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] publish_errors = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.214944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] standard_threads = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] standard_threads = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.215991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] use_journal = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] use_json = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] use_journal = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] use_stderr = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] use_json = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] use_syslog = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] use_stderr = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.216949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] use_syslog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.217007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.217136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 15:58:39.217220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.217961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.218934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.219973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.220954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.221931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.222949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.223976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.224975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.225887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.226920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.227898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.228802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.229961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.230961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.231927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.232920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.233900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.234968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.235968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.236889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.237977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.238915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.239878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.240861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.241983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.242999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.243941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.244995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.external = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.245862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.external = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.password = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] auth.token = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.246972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.password = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.token = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.247913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.248955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.249971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.250947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.251947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.252954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.253908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.254856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.255958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.256991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.257943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.258861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.259839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.260964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.261980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.263882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.264865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.265967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.266987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.267142 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.267233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.267855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.268978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.269120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.269191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.269262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.269333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.269780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.270947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.271757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.272878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.273720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.274963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.275974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.276936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.277993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] role.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] role.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] role.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.278915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] role.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.279877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.280932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.281879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.282921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.283983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.284953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.285871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.286986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.287931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288009 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.288995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.289946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.290899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.291896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.292883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.293959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.294975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 15:58:39.295613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.295801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.296033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 15:58:39.296402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 15:58:39.326507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.326661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.326747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.326889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.326972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.327122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.335747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.335927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.363964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.364214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.364498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.364724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.509899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.513049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.558533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.558748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.559217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.559455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.623942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.624740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.648267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.648408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.648646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.648806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.648937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.649660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.660606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.660855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.673283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.673504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.673703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.673793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.673917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.674937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 15:58:39.691826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.692018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 15:58:39.692147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.692313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 15:58:39.692489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.692566 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 15:58:39.692641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.692844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 15:58:39.693097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.693902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.704483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.704713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.704842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.704998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.705095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.705242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.705327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.705455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.713939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.714067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.717233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.717361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.717514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.717640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.717799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.717912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.718909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.719962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.720098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.746384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.746518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.747977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.748104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.748273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.748422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.753526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.753802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.753933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.754055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.754151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.754217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.761417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.761544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.761703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.761817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.766226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.766353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.766500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.766628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.766769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.766853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.766976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.767897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.768050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.768192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.786579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.786851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.786977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.787137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.791471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.791787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.795090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.795377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.795501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.795722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.800560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.800984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.804130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.804634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.807747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.808873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.809000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.809138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.809259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.809434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.809711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.828166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.828482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.828740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.828904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.829020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.829154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.829457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.829718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.837240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.838054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.838928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.839156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.839763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.840035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.842386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.842658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.842930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.843266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.843396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.843539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.843640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.843883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.844159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.844434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.856789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.857060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.857333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.857605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.857829 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.857969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.858947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.859227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.859510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.877450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.878718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.880724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.882030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.884020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.885381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.885626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.886993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.887375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.887650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.887935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.888770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.889044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.889329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.895300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.896725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.896920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.898442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.900125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.900410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.900715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.900986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.901706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.901994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.902276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.902548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.910375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.910655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.910924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.911853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.912136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.912419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.918763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.919043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.919318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.919591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.919854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.920124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.920356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 15:58:39.920511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.920676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.920762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.920909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.921859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.922908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.923185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.923455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.923720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.923984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 15:58:39.960117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ef013a9c0 pid: 80423 (default app) Jul 05 15:58:39.962059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ef013a9c0 pid: 80424 (default app) Jul 05 15:58:39.963476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-ef02-42cd-bb3c-ee147c6596c7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:39.963762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-ef02-42cd-bb3c-ee147c6596c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:39.964045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-ef02-42cd-bb3c-ee147c6596c7 None None] PATH_INFO: `/v3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:39.968403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Jul 5 15:58:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:47.625266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:47.625867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:47.625867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:47.630224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:58:47.636672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:47.637407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:47.637538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:47.709258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: INFO dbcounter [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] Registered counter for database keystone Jul 05 15:58:47.734018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 15:58:47.741583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writer thread running {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 15:58:47.918869 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80423) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 15:58:47.919281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80423) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 15:58:47.974661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:47.976304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:48.111994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 15:58:48.326715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:48.396890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: INFO dbcounter [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] Registered counter for database keystone Jul 05 15:58:48.418477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 15:58:48.430796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writer thread running {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 15:58:48.558521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f448d-7bed-4720-8a60-7777410f93b9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:48.563965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:48.564664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:48.564946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:48.565219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:48.574331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:48.625875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 15:58:48.626447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae746-a2b0-4e5b-9dca-0deb3c1e953e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:48.636318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jul 5 15:58:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 15:58:48.643411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:48.667967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a86039-99f4-4517-b897-f86ab970f6bf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:48.675515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:48.676702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:48.676989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:48.677266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] PATH_INFO: `/v3/projects/d319fa168ab84848b7e88269fc1c486a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:48.678978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d319fa168ab84848b7e88269fc1c486a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:48.734915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 15:58:48.735266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b92-49d9-4ce7-b576-1b5fd0c08ae0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:48.740090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Jul 5 15:58:48 2022] GET /identity/v3/projects/d319fa168ab84848b7e88269fc1c486a => generated 344 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:50.778466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646659-d826-4284-be22-c0261ace4ee9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:50.779015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646659-d826-4284-be22-c0261ace4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:50.779015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646659-d826-4284-be22-c0261ace4ee9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:50.783208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:50.789925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:50.790630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:50.790827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:50.813308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:50.814856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:50.825438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 15:58:50.847442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646659-d826-4284-be22-c0261ace4ee9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:50.861016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646659-d826-4284-be22-c0261ace4ee9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:50.866600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:50.867224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:50.867511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:50.867779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:50.876382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:50.878200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac38c0-f998-4914-a874-12396285a444 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:50.887591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jul 5 15:58:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 15:58:50.893591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:50.908176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565a2f-4779-4c44-936c-b0ebc9d7ce54 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:50.917256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:50.918549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:50.918927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:50.919299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:50.921600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:50.923483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf505b-556d-44e0-a20c-9daaf118de20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:50.925109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Jul 5 15:58:50 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:52.979427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530ba3-abf9-47ab-9270-5a52623ad814 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:52.980006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530ba3-abf9-47ab-9270-5a52623ad814 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:52.980006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530ba3-abf9-47ab-9270-5a52623ad814 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:52.981476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:52.986844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:52.987254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:52.987411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:52.996555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386673bf-8025-4de6-abad-ebe50dc8bfff None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:52.996867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386673bf-8025-4de6-abad-ebe50dc8bfff None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:52.997147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386673bf-8025-4de6-abad-ebe50dc8bfff None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:52.998460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:53.003371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.003663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.003941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.005112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:53.006316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:53.043140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80424) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 15:58:53.043559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG passlib.handlers.bcrypt [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80424) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 15:58:53.088872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:53.090476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:53.093915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:53.116943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.140230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.190491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:53.212765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.218851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506e60-dc02-48ca-beec-f2dbc367a8f2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.251484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.252282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.252635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.252920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.264827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:58:53.276040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:58:53.276990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:58:53.277809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:58:53.283278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.313161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489cc2a-ed82-4ff2-a2e3-96df74c2831e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.315555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.350542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.351446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.351767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.352041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.363928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.383769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f681-a117-46b1-9cf8-c6494616361b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.416582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.417257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.417539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.417822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.418586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:58:53.418895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.419523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.420313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.421130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.432726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:58:53.438546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.519558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 15:58:53.525248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.527949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.543408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3869-7bf2-419c-8bf3-258155806ee1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.579622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.580866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.581225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.581522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.583717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.586017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.588465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:58:53.593857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.608717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.629653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb77070-cf2d-4ef2-af3e-4ef0b6fd21e9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.661714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.662525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.662811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.663089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.681120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.682614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.691821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb9fd-f953-4784-a9d3-b248209298b7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:58:53.705341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:58:53.706154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:58:53.708059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:58:53.708059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:58:53.708059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:58:53.708059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:58:53.708059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:58:53.712773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.727719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.728568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.728853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.729135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.730344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.731911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.733672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:58:53.739304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:53.767212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.810820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bc94d-c545-4ad3-9d60-e2951abf24b6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.819166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:53.839114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfcd6-ab6a-4fe4-b4b0-4290decd337f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:53.843267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.843934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.844219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.844516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.845224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:58:53.845526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.846938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addf999-39dc-4b90-a514-9911923f3dbe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.863897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:58:53.880610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:53.881287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:53.881605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:53.881888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:53.882756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.domain.id=default, user.id=43433f69b2c244e5a234c2286e9ce5fb) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:58:53.883067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:53.884617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65367-7da0-4960-8db0-855dc113543e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:53.892844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jul 5 15:58:53 2022] GET /identity/v3/role_assignments?user.id=43433f69b2c244e5a234c2286e9ce5fb&scope.domain.id=default&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:56.276568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e056-5260-49b6-9e6b-9bef8e27dc59 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.277611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e056-5260-49b6-9e6b-9bef8e27dc59 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.278154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e056-5260-49b6-9e6b-9bef8e27dc59 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.279752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:56.285278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770c84-f267-44b4-8065-7bab540c2490 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.286103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770c84-f267-44b4-8065-7bab540c2490 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.286592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770c84-f267-44b4-8065-7bab540c2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.307964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f2770c84-f267-44b4-8065-7bab540c2490 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:56.309595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f2770c84-f267-44b4-8065-7bab540c2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:56.398894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:56.434106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633e056-5260-49b6-9e6b-9bef8e27dc59 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:56.572004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633e056-5260-49b6-9e6b-9bef8e27dc59 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:56.595781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:56.616940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:56.617761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.618046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.618323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.635197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43b49f-825c-4c93-b580-c3cf7c51b6a2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.635786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43b49f-825c-4c93-b580-c3cf7c51b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.636271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43b49f-825c-4c93-b580-c3cf7c51b6a2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.637188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:58:56.638089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:58:56.643126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a600-a4d2-4aee-9e7d-59b75f98f282 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.643647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a600-a4d2-4aee-9e7d-59b75f98f282 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.644123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a600-a4d2-4aee-9e7d-59b75f98f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:58:56.648469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:58:56.649291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:58:56.650046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 12/25] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:58:56.653973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:56.685665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5917a600-a4d2-4aee-9e7d-59b75f98f282 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:56.687349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5917a600-a4d2-4aee-9e7d-59b75f98f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:56.796164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d57731-442d-41f3-b5ff-b6b01674ff1e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:56.818437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:58:56.821548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ed3-2d01-4a02-b3bc-f7e281185bfa None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.822228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ed3-2d01-4a02-b3bc-f7e281185bfa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.823554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4ed3-2d01-4a02-b3bc-f7e281185bfa None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.828931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 15/27] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:56.838407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.839026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.839492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.850747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:56.867353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:56.868576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:56.873814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:56.874552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:56.874834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:56.875109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:56.875876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:58:56.876182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:56.877623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:56.899823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 13/28] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:58:56.900693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:56.954100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:56.981055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:58:56.982637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.048025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bda5f-1a71-44c9-8164-80b7b3879183 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.097785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f86e-6386-4b59-9f2c-cd3f42b4c50c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.098622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.099716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.100133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.101463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.102368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.103905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.141185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.142317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.142732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.143137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.144737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.146375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4805b-4b6c-4616-b0be-9ceec3bd858c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.148302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 17/30] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:58:56 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:57.149725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334dd8-4e0c-43b4-ac10-8aca387cedc8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.150191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334dd8-4e0c-43b4-ac10-8aca387cedc8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.150618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334dd8-4e0c-43b4-ac10-8aca387cedc8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.151969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 18/31] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:57.152914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334dd8-4e0c-43b4-ac10-8aca387cedc8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.156107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:57.245956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 14/32] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 5 15:58:56 2022] POST /identity/v3/roles => generated 225 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:58:57.247427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.288212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334dd8-4e0c-43b4-ac10-8aca387cedc8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.379912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:57.385315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8a93-f462-43d4-bec0-15e33b46c0e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.400045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.400825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.401108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.401386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.402273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.403714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010a926-ce72-4dd8-a4ed-230a9063d356 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.433365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.434605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.435095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.435625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.437589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.439464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6047dd-e767-4996-8513-140864f6a485 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.441491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 15/33] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:57.443126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2a09-4bc2-433f-ac41-9b83b7db886f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.443618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2a09-4bc2-433f-ac41-9b83b7db886f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.444139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2a09-4bc2-433f-ac41-9b83b7db886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.464004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a26f2a09-4bc2-433f-ac41-9b83b7db886f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:57.466108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a26f2a09-4bc2-433f-ac41-9b83b7db886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:57.532664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 19/34] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 5 15:58:57 2022] POST /identity/v3/roles => generated 219 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:58:57.534159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d2-f0d2-4b03-9876-efa52e92dadc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.534481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d2-f0d2-4b03-9876-efa52e92dadc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.534740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1877d2-f0d2-4b03-9876-efa52e92dadc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.540762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 20/35] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:57.540762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1877d2-f0d2-4b03-9876-efa52e92dadc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.568517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 16/36] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:57.568517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29b55-388a-4925-9768-d326252f2718 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.568517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29b55-388a-4925-9768-d326252f2718 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.568517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29b55-388a-4925-9768-d326252f2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.597681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0db29b55-388a-4925-9768-d326252f2718 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:57.599182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0db29b55-388a-4925-9768-d326252f2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:57.650789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:57.696594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 17/37] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:57.697847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29b55-388a-4925-9768-d326252f2718 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.706137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1877d2-f0d2-4b03-9876-efa52e92dadc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.735990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:57.749823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.750730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.751012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.751290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] PATH_INFO: `/v3/domains/default/users/43433f69b2c244e5a234c2286e9ce5fb/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.754751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=43433f69b2c244e5a234c2286e9ce5fb, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.756165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.776050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 21/38] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 5 15:58:57 2022] PUT /identity/v3/domains/default/users/43433f69b2c244e5a234c2286e9ce5fb/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:58:57.777185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:57.848617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29b55-388a-4925-9768-d326252f2718 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:57.884776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:57.885626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.885900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.886174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.898147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:57.899733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fbf2989f-1b59-4295-b60f-55d81fd93d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:58:57.920089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:58:57.921127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 18/39] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4bc3-9b9f-4c21-a31d-90f19dfb6a7a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4bc3-9b9f-4c21-a31d-90f19dfb6a7a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4bc3-9b9f-4c21-a31d-90f19dfb6a7a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.930962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 19/40] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:57.933228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:57.933526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:57.933805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:57.953156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:57.954405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:58.024245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d6d2-5ffc-473f-a0ce-ba1fd9d4426d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:58.036480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 20/41] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:58.036480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:58.045328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:58.057520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:58.072264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:58.073109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:58.073394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:58.073674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:58.075421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:58.076311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:58.078184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 22/42] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:58.080374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:58.148189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a425b-7277-48a3-9bda-f00f77efe99d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:58.183136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40ceec-96b8-4f78-a0de-0c56351f6314 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:58.188094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:58.188979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:58.189405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:58.189824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:58.191235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:58:58.191714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:58.193786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:58.209246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:58:58.214317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:58.219650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:58.220491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:58.220867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:58.221247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:58.222107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:58.223660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:58.239918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 5 15:58:58 2022] POST /identity/v3/roles => generated 223 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:58:58.240906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:58:58.291109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:58.328591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:58:58.341678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6c4ba-93e7-4b66-a3ee-3b9066e94526 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:58.386906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:58.388329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:58.388788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:58.389213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:58.391280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:58.393001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a8f7d-aa8b-47cb-905f-619e325c1145 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:58.399221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436b25e-d4b8-42a5-83d5-3852c06b2044 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:58:58.427275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 15:58:58 2022] POST /identity/v3/projects => generated 312 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:58:58.448023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:58:58.449566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:58.449566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:58.449566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:58.450389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:58:58.452106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef908b-d5d4-4351-ad5e-72398b43b06d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:58:58.500884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 15:58:58 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:58:59.815187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0b91-e13c-432e-b005-50c3c21959b4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:59.815726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0b91-e13c-432e-b005-50c3c21959b4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:59.815726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0b91-e13c-432e-b005-50c3c21959b4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:59.817159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 23/47] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:58:59.822527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:58:59.822947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:58:59.823096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:58:59.841663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:58:59.843207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:58:59.914605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:58:59.937517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a0b91-e13c-432e-b005-50c3c21959b4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.042781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a0b91-e13c-432e-b005-50c3c21959b4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.175222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.190226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.191071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.191387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.191693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.202018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:00.210105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:00.211086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:00.217058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 24/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:00.218050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.250146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.323479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515335d-1e1b-4305-9815-5733d9ee07a1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.359117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.359797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.360088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.360369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.361169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:00.361481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.362877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d347c-6bca-46ee-8009-9df6cb5c323a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.371331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 26/50] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:00.377328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.464974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bdd5c-621a-4994-80d1-4deef27ca602 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.465185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bdd5c-621a-4994-80d1-4deef27ca602 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.465467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bdd5c-621a-4994-80d1-4deef27ca602 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.466864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 27/51] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:00.472746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.473053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.473336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.483903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf2cb-4d7a-4a00-bc58-2dc370ca603b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.490427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:00.491610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:00.518822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.519719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.520004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.520283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.521763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.523229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.525063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 25/52] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:00 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:00.530424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.557150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 28/53] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:00.576629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.580194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.604518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.628479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f2e8b-4f45-4965-91b1-d5e326ea958e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.660654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.661468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.661755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.662037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.663223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.664728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.666393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 26/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:00.672195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.684015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763e503-0782-4ddb-92b8-b594ffa0c144 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.718418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.719157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.719440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.719716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.720931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.722375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.724157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 29/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:00.729438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:00.769572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cddd6-cac9-45a1-b907-7c49112ee7f5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.785687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.804136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.804833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.805122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.805405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.806246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.domain.id=default, user.id=43433f69b2c244e5a234c2286e9ce5fb) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:00.806559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.808013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2989b-a409-4b42-a245-ae92b1b34fd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.816057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:00.817405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 27/56] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jul 5 15:59:00 2022] GET /identity/v3/role_assignments?user.id=43433f69b2c244e5a234c2286e9ce5fb&scope.domain.id=default&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:00.825365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a992-4fd4-4b2c-9fec-ab057829df42 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:00.862507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:00.863200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:00.863489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:00.863771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:00.864549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:00.866108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8b68b-03b6-4ca7-9a5a-bd2f8048faa7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:00.895401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 30/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jul 5 15:59:00 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 15:59:02.923176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35ea4-b27c-4c57-a724-c5e11ad08fbf None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:02.924019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35ea4-b27c-4c57-a724-c5e11ad08fbf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:02.924019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35ea4-b27c-4c57-a724-c5e11ad08fbf None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:02.926369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 28/58] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:02.934921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:02.935594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:02.935888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:02.960394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:02.961627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:03.029157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:03.066598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35ea4-b27c-4c57-a724-c5e11ad08fbf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:03.175188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35ea4-b27c-4c57-a724-c5e11ad08fbf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:03.211032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:03.211833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:03.212119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:03.212395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:03.213709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:03.215175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61132ee-1f5a-4ab6-a503-97c0d83e2c59 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:03.216855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 29/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:03.222576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:03.301052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:03.335145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff69968-bc8f-4866-a653-8e88b50a4c2a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:03.371531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:03.372200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:03.372495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:03.372786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:03.373508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:03.375078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54395a-8a32-4fdd-9cfe-5955823ae89b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:03.399315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 32/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:03 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:06.567343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0f6d-9cbc-4554-8353-dfad727e3c44 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.568763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0f6d-9cbc-4554-8353-dfad727e3c44 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.569521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0f6d-9cbc-4554-8353-dfad727e3c44 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.571581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 30/62] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:06.577352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.578442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.579265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.605506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:06.607068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:06.667285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb90b-7742-470f-91cd-c74182b0e1d9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.667915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb90b-7742-470f-91cd-c74182b0e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.668255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb90b-7742-470f-91cd-c74182b0e1d9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.669739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:06.676819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e74c1-bb39-4815-b519-1775204ed4d7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.677333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e74c1-bb39-4815-b519-1775204ed4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.677802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e74c1-bb39-4815-b519-1775204ed4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.692050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:06.709586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d22e74c1-bb39-4815-b519-1775204ed4d7 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:06.710955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d22e74c1-bb39-4815-b519-1775204ed4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:06.718981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:06.794360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:06.808807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:06.831846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 32/65] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:06.846931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f629-8e29-4df3-814c-9a1a8ce83557 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.847516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f629-8e29-4df3-814c-9a1a8ce83557 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.847979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f629-8e29-4df3-814c-9a1a8ce83557 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.849555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 33/66] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:06.855394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fa2c-40db-482d-ad1b-5302e50662a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.855688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fa2c-40db-482d-ad1b-5302e50662a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.855972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fa2c-40db-482d-ad1b-5302e50662a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.876185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8069fa2c-40db-482d-ad1b-5302e50662a6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:06.878191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8069fa2c-40db-482d-ad1b-5302e50662a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:06.882645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e268a8-6e99-4c3c-b31b-f33ad04d8a91 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:06.919436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:06.920255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.920575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.920891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.932543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:06.941078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:06.942025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 34/67] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:06.943623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 34/68] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c82f-2543-4a8e-a473-4f616ea952e9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c82f-2543-4a8e-a473-4f616ea952e9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c82f-2543-4a8e-a473-4f616ea952e9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 35/69] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:06.959478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c82f-2543-4a8e-a473-4f616ea952e9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.053543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703db24-e794-4bc5-bfb6-610c1b7cbdb6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.071321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c82f-2543-4a8e-a473-4f616ea952e9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.075692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.080734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.093254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.094081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.094370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.094654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.105633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:07.106695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.107385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.107675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.107958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.108795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:07.109111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.110531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f4e8d886-2b75-4fc3-8c6e-e916329b1873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:07.113330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:07.114161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 35/70] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:07.120514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.121195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.121195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.127729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.127729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.139841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:07.141211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:07.214148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 36/72] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:07.215236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.233404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384791b9-d75b-4473-aa2d-2c0a5f4a9952 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.267273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.268081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.268368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.268700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.269881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.271343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.273035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.273793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.313232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.325944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a86ea-3523-432b-be8b-abd03bbc32a4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.337783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.362294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.362975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.363262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.363542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.364304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:07.364643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.366100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.372113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361f9b-1f46-48f2-8685-e872febb7d07 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.378714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 37/74] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.378714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.404015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.404929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.405232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.405503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.420128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.421743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adda6-16d0-4e6f-a950-abfa600dc11c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.423617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.424671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570fb2-5576-4cfd-927b-3be600de87bd None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.424964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570fb2-5576-4cfd-927b-3be600de87bd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.425249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570fb2-5576-4cfd-927b-3be600de87bd None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.426665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 39/76] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:07.427192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570fb2-5576-4cfd-927b-3be600de87bd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.478051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20cc49-9af6-4264-abea-3748f8b55a04 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.513759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.514646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.514935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.515226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.524729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.525712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:07.533800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570fb2-5576-4cfd-927b-3be600de87bd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:07.534356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:07.535309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:07.536056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 38/77] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:07.537118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.569769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.573057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.573739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.574051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.574322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.575050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.576544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.604782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 40/78] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:07 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:07.605615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.656028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58248-bdae-414f-a901-aa58c19cb40e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.695153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.696115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.696487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.696865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.698008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.699525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f466a0-9cd1-4056-bcec-3248638e79bd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.701441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 39/79] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.702593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.702885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.703167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.721894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:07.723155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:07.725574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f633-a538-45f3-ba8e-54e8d9492cc5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.762292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.762962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.764091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.764091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.788121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.799833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:07.800795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.838230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.840069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:07.840193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.935326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb07614-b8bb-49b5-86f4-92c13dc82cb9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:07.962343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 41/81] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:07.967658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:07.974913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:07.975720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:07.976124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:07.976493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:07.977385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:07.977770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:07.979330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:07.988194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 41/82] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:07.989162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.020759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.077196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b2542-6d8a-489e-889a-4e4452edee8d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.107727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.116492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.117378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.117804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.118221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.118474 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b13bfa-93c2-4da1-8cef-dd57ac2a1164 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.158728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.159944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.160429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.160957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.172749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:08.180718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:08.181571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:08.182336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:08.184747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:08.185738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.194356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.195866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.259034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.304085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518faf-a228-459b-9ae3-7850ffd73a6f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.325555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:08.327252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.338129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.339019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.339340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.339621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.340854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.342397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.344163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.349691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.372366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.455400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52d9a-dad5-4ba9-906b-3427857f6d97 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.463470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79247-556c-4875-803b-9a701b088f8e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.493605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.494370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.494730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.495065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.495903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:08.496277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.497912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.506985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 44/86] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.512514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.515747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.518214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.518214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.518214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.521184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.522872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.525806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 43/87] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.529828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.565424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.606538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.633995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5c22b-ed94-4078-ab92-3557c5237908 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.657406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b720a-ad30-42b5-b2da-aa4e31de1b99 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.681259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.683305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.684021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.684548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.686910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.689303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.696623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.696623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.701012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.701627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.701968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.702245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.703081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:08.703388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.704863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.711342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 44/89] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=440da6136d59483baa79a4c88adb52a0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.712040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.823884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8025-82de-4adf-b15f-dcea7aaf5d24 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:08.868672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:08.870704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:08.871209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:08.871684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:08.873374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:08.875556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:08.882047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:08.883345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:08.907943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.952522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:08.977668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a4056-d8d9-489b-8300-58c792a4c522 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.013236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b7d0-31a9-42bc-9b50-4f205c6a3445 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.021152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.022589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.023079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.023578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.087161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.087828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.088125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.088414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.089309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=43433f69b2c244e5a234c2286e9ce5fb) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:09.089626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.091193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.101625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.108576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 47/91] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/role_assignments?user.id=43433f69b2c244e5a234c2286e9ce5fb&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:09.108576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:09.110910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.229640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:09.256172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 45/92] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:09.257924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:09.315125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:09.363228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ec77-519f-42fe-946a-df69720b038f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.376292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13f776-8a88-4305-a87d-81e4888d2fd6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.416179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.417473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.417981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.418480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.420687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.422436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.428601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:09 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:09.430603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:09.470978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.470978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.470978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.470978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.498307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:09.548747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2adb7-3631-480c-b045-c60b7f9ec3c3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.584824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.585861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.586413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.586918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.588020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:09.588598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.590415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.596862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 47/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:09 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:09.633286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.634822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.771406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:09.795304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 48/95] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:09.801236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:09.920285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f826-21d9-4792-8c34-1e9ff0ba4905 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:09.942193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:09.961837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:09.963092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:09.963577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:09.964050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] PATH_INFO: `/v3/projects/4b6716f45abf4b16b80c58f3807edf80` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:09.965531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] RBAC: Authorizing `identity:get_project(project_id=4b6716f45abf4b16b80c58f3807edf80)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:09.967240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036c45b-0095-47d9-89f2-2168a8161b6d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:09.969311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:09 2022] GET /identity/v3/projects/4b6716f45abf4b16b80c58f3807edf80 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:09.977586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:10.104007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af27a-b8c5-4d7a-a29f-143986495769 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:10.144037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:10.144740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.145032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.145315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.146174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=4b6716f45abf4b16b80c58f3807edf80, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:10.146497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:10.147972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7a46b-3713-4387-ac41-19f6e0b2027a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:10.154200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:09 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=4b6716f45abf4b16b80c58f3807edf80&role.id=440da6136d59483baa79a4c88adb52a0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:10.258184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161d0-bf8d-4453-85a9-a910c28f5f9c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.258823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161d0-bf8d-4453-85a9-a910c28f5f9c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.259326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161d0-bf8d-4453-85a9-a910c28f5f9c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.261333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:10.267742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.268048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.268331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.291097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:10.292331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:10.310131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a31d-5c2b-4430-afef-16b7a992c879 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.310517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a31d-5c2b-4430-afef-16b7a992c879 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.310701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a31d-5c2b-4430-afef-16b7a992c879 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.312437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 50/99] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:10.317958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.318250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.318532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.355086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:10.356252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:10.397148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:10.441644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:10.467931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:10.479041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:10.522569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:10.648468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f6d54-0906-43e5-b147-64c8160d0a0a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:10.690729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb9ed-155f-4e73-87f3-64af252bb8a1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:10.718423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:10.719242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.719524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.719808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.722483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:10.736739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:10.744578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:10.745502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:10.746327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:10.748654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 51/102] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:10.756044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:10.759644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:10.761503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.766871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.767361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.770390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:10.772084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:10.773991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 52/103] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:10.781353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:10.821622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:10.929239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523695ff-5c7d-4e84-96f1-b290dc6f3c96 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:10.955485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4ead-1564-4dcd-ae95-cd37cdf6c7ef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:10.996528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:10.997560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:10.998051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:10.998513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:10.999500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:11.000019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:11.001659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:11.014456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 52/104] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:11.019410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:11.020336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.021504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:11.021979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.022440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.023346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:11.025420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:11.075141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 53/105] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 15:59:10 2022] POST /identity/v3/projects => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:11.168314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:11.177333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af76380-d588-4c8f-a97a-3ac1a429fba0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:11.224115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:11.224960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.225244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.225522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] PATH_INFO: `/v3/users/f5b6501746a946e1946240378bce5165` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.244998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b6501746a946e1946240378bce5165)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:11.246539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:11.248503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 53/106] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:11 2022] GET /identity/v3/users/f5b6501746a946e1946240378bce5165 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:11.254336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:11.297383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:11.387487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209959-f298-4fe5-8e56-8d62f33ef0ae None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:11.442997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:11.443669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.443953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.444230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.526952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:11.528460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f549d5-8e51-4f7e-8e2f-cf8eaf1fb07d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:11.562316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:11.637362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 54/107] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:11.645559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:11.646019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4c29-9e6d-4033-a341-5fbedc57af96 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.646313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4c29-9e6d-4033-a341-5fbedc57af96 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.646597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4c29-9e6d-4033-a341-5fbedc57af96 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.648183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 55/108] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:11.653578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.653866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.654147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.689106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:11.690306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:11.792152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 56/109] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 15:59:11.819261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7f43-cf2b-4ef8-8998-8cf8b634e555 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:11.863418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:11.864305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:11.864657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:11.864940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:11.866475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:11.868010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:11.869971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 54/110] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:11 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:11.875679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:11.897867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:11.940647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:11.984922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:12.033104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1469666-5a03-4b34-9f41-a9fdd2314ed9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.052399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b348a10-4911-4297-92db-8632b98e6d17 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.069567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.070574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.070922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.071266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.072344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=f5b6501746a946e1946240378bce5165) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:12.072751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:12.074678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:12.081970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 57/111] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:11 2022] GET /identity/v3/role_assignments?user.id=f5b6501746a946e1946240378bce5165&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:12.093916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.095122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.095632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.096107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.109774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:12.118198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:12.119112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:12.119865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:12.122765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 55/112] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:12.129224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:12.276352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44981693-b41c-409b-8e96-9d0baf965356 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.325535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:12.338477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.339559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.340079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.340583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.341574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:12.342101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:12.343799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c981bf-8e61-4649-acb0-f41728313cbc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:12.356971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 58/113] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:12.363067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:12.460829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:12.480223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73198c0f-4014-4bc4-b331-5975f15ab8bc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.498124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc4c7-e907-4ccf-b579-3f8b4bd7aa9d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.498423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc4c7-e907-4ccf-b579-3f8b4bd7aa9d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.498757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc4c7-e907-4ccf-b579-3f8b4bd7aa9d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.500309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 59/114] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:12.516281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.516605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.516878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.532756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.533998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.534478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.534950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.536387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:12.538139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:12.540009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 56/115] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:12 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:12.543104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:12.544330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:12.551058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:12.703245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 60/116] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:12.742095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:12.774633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b471-ce5f-4d4e-a19a-279ca04a0148 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.828632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.829812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.830239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.830659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.832200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:12.834275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e705ad-c455-4aa0-95b2-59a007a3aba3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:12.838234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 57/117] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:12 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:12.844208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be7269-186e-40c2-8deb-e3fdea2ad921 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.844798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be7269-186e-40c2-8deb-e3fdea2ad921 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.845288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be7269-186e-40c2-8deb-e3fdea2ad921 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.846841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 58/118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:12.847935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be7269-186e-40c2-8deb-e3fdea2ad921 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:12.872297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:12.897567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a1c6-987c-4db8-bd16-65fa7c9a586e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.933186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:12.958505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:12.959274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:12.959559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:12.959841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:12.971604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be7269-186e-40c2-8deb-e3fdea2ad921 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:12.993688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c2cd771d-b76c-4ba5-85f5-877e632b3932 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:13.012216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:13.013145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:13.013894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:13.018164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 61/119] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:13.019663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc6b7-a851-4429-b056-27c8bab31775 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.021775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc6b7-a851-4429-b056-27c8bab31775 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.022279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc6b7-a851-4429-b056-27c8bab31775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.036034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.037291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.037778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.038270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.040549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.041073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bfafc6b7-a851-4429-b056-27c8bab31775 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:13.042322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bfafc6b7-a851-4429-b056-27c8bab31775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:13.042662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.059470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 59/120] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:12 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:13.064483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.118137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 62/121] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:13.120141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe406-c01e-4d30-9b25-b172638edd2b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.120788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe406-c01e-4d30-9b25-b172638edd2b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.121206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe406-c01e-4d30-9b25-b172638edd2b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.123422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 63/122] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:13.129908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.130410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.130829 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.151380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:13.152911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:13.234501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:13.262199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3549d7-3327-43d5-8bef-61898c2cc434 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.290723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 64/123] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:13.291616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.340652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.340992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:13.341626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.341917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.342202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.343025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:13.343481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.344790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.358602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 60/124] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:13.359630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.405588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f1aa-6f47-49de-acbf-9bf28f7c733f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.442655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.443512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.443793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.444070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.457026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:13.465319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:13.466149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:13.466913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 65/125] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:13.467583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.489902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30e0a-5e0f-4dfa-81d8-76c6132e0598 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.546146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.546972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.547261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.547594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.566933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:13.574852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:13.575693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:13.576485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 61/126] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:13.577646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.582716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:13.583023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:13.591451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5d3b2-9a2a-4f99-92b0-9e05cbf7363c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.649770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.650779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.651065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.651340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.653154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.655504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.657643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 66/127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:13.658451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.690500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de3c38-fc69-448d-8f45-f8094b03764f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.728711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.729881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.730385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.730879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.731835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:13.732339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.734055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.743357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 62/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:13.744649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.832933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:13.854105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b094d-298a-4832-aa98-ff5d52d10355 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.866928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce039b-f79b-4f88-8e92-4a39b1c89269 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:13.895002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.896629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.897305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.898439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.900059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.902554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.904692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 63/129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:13.907076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:13.938705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:13.940963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:13.942350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:13.942833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:13.943797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:13.948923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:13.950444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:13.968767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 67/130] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:13.969492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.029488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.032429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef395-3343-42e6-949d-75e3ab751d8a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.068193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.069570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.070162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.070641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.072116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.076683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.077228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.080286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 64/131] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:13 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:14.081435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.191565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a188-7346-476a-bb42-587932dc35f1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.226185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352a2b-b2f2-46f1-988f-8e8f18352ff0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.229933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.231114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.231594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.232065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.233632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.235333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.237248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 65/132] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:14 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:14.238344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.284278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.285195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.285515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.285804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.294362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2, role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.296047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.309795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.322712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 68/133] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:13 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:14.323756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.350249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c875d-3c58-44a1-bd18-8f15e70e975f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.389512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.390860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.391366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.391836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.393306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.395062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.397286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 66/134] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:14 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:14.404614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.457640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.471105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c480ec-fc91-43ca-9697-b36346da74a3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.534232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cca6-c723-4f7d-9e8c-5b7a2db5a2c3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.552857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.553690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.553971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.554259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] PATH_INFO: `/v3/projects/4b6716f45abf4b16b80c58f3807edf80` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.561711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=4b6716f45abf4b16b80c58f3807edf80)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.563222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bca98d-8b69-4d3b-a229-7a39c1199ef9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.565806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 69/135] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:14 2022] GET /identity/v3/projects/4b6716f45abf4b16b80c58f3807edf80 => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:14.567016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e583-4459-49b9-8d1c-5b6b24cdb977 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.567308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e583-4459-49b9-8d1c-5b6b24cdb977 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.567612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e583-4459-49b9-8d1c-5b6b24cdb977 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.573174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 70/136] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:14.575098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336e583-4459-49b9-8d1c-5b6b24cdb977 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.583833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.585057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.585540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.586013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/43433f69b2c244e5a234c2286e9ce5fb/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.588337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, user_id=43433f69b2c244e5a234c2286e9ce5fb, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.590086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8129-0413-4894-b59c-2785aa925736 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.593699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.606702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 67/137] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:14 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/43433f69b2c244e5a234c2286e9ce5fb/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:14.607181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2b241-33fb-444a-95aa-864218a9dd7f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.607430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2b241-33fb-444a-95aa-864218a9dd7f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.608134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2b241-33fb-444a-95aa-864218a9dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.632416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6cc2b241-33fb-444a-95aa-864218a9dd7f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:14.632416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6cc2b241-33fb-444a-95aa-864218a9dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:14.780472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 68/138] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:14.780472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3d6f-af83-4d62-8524-d83fc01c807e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.780472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3d6f-af83-4d62-8524-d83fc01c807e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.780472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3d6f-af83-4d62-8524-d83fc01c807e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.780472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 69/139] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:14.784976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.785275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.786027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.801216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336e583-4459-49b9-8d1c-5b6b24cdb977 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:14.812536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:14.813862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:14.841622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:14.842931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:14.843358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:14.843794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] PATH_INFO: `/v3/projects/4b6716f45abf4b16b80c58f3807edf80/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:14.845949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] RBAC: Authorizing `identity:create_grant(project_id=4b6716f45abf4b16b80c58f3807edf80, user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:14.847538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:14.865014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 71/140] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:14 2022] PUT /identity/v3/projects/4b6716f45abf4b16b80c58f3807edf80/users/6b9362973b5a47cba4f2a0e6e0f1c8f2/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:14.868481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:14.888461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:14.942169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 70/141] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:14.977531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.018110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa404-3209-4340-a92c-a3afca51d46e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.081274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.082056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.082316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.082598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.085814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:15.087343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:15.089117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 72/142] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:15.103495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.113853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:15.193672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6a3a-14d0-4b91-a4cd-26307eeda8b4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.221950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:15.238132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7254e11-ad6f-4fad-91c5-b449d194a40c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.268200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.273149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.273521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.273811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.301379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:15.310677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:15.311677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:15.312479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:15.317792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 71/143] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:15.323863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.326494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.327554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.327850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.328129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.328880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:15.330356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:15.375604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 73/144] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:15 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:15.478856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de6e8-0772-46d3-8012-069051bbc8ca None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.500913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:15.519080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.519774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.520055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.520329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.521128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:15.521435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:15.522873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:15.533080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 72/145] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:15.538672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.647644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69514e5-7807-4f1e-bfc9-d186e2e3cd78 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.689464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.690365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.690647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.690923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] PATH_INFO: `/v3/users/f5b6501746a946e1946240378bce5165` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.692130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b6501746a946e1946240378bce5165)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:15.693655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:15.695325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 74/146] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:15 2022] GET /identity/v3/users/f5b6501746a946e1946240378bce5165 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:15.701193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.806397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c8bc-b2c6-47c9-a4ef-32bf9d320919 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:15.841241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:15.842168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:15.842570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:15.842844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:15.844038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:15.845539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199356-88bd-4484-8d2c-a114803d9576 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:15.847536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 73/147] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:15 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:15.853294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:15.866588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:15.980474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df20c7-77d3-4286-b4d0-92eb23ff12e0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:16.021428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:16.022334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.022615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.022901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/f5b6501746a946e1946240378bce5165/roles/403f6c908b7c4e4d806ee567232b1ba5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.027674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, user_id=f5b6501746a946e1946240378bce5165, role_id=403f6c908b7c4e4d806ee567232b1ba5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:16.029181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1617e-3bd8-4279-a46a-0a862981c514 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:16.054457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 75/148] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:15 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/users/f5b6501746a946e1946240378bce5165/roles/403f6c908b7c4e4d806ee567232b1ba5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:16.129255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d104-f031-4785-80fe-1fd1de2f1e87 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.129960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d104-f031-4785-80fe-1fd1de2f1e87 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.129960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d104-f031-4785-80fe-1fd1de2f1e87 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.131487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 74/149] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:16.136731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.137235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.137410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.158103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:16.159354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:16.234070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:16.239203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 76/150] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:16.275513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d104-f031-4785-80fe-1fd1de2f1e87 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:16.338103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:16.405485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d104-f031-4785-80fe-1fd1de2f1e87 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:16.445128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:16.445954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.446231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.446510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.459401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:16.467700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:16.470317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:16.472198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 75/151] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:16.480023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:16.607002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ad27-e27a-4c01-8f8a-695c3985c9a3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:16.643027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:16.643714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.643997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.644275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.645058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:16.645365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:16.646772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:16.658436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 77/152] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:16.663849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:16.771991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97301265-daef-4e33-88e7-548ca5ae7952 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:16.779563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:16.808718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:16.809610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.809880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.810148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:16.811422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:16.812930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:16.814883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 76/153] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:16 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:16.820302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:16.890928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:16.934126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0933ba-bc0e-4441-8d49-3cfe93ed0ef6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:16.969375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:16.970109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:16.970340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:16.970603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.046333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:17.047795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:17.119986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:17.169044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:17.174824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:17.281365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113bd79-f0c2-4d6b-93d6-ea7aa1137370 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:17.316423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:17.317248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:17.317528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:17.317803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.319006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:17.320481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8298f3-c3b8-4ba5-9d23-a109f88c06f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:17.322474 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 77/155] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:17 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:17.328241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:17.415112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff23-19ce-4b53-9393-58ac4b96f9e4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:17.415419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff23-19ce-4b53-9393-58ac4b96f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:17.415655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff23-19ce-4b53-9393-58ac4b96f9e4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.417083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 78/156] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:17.440854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:17.442481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:17.443290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.461048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ffd10-d31f-49b2-a444-9f8654633e8a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:17.474639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:17.476197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:17.528835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:17.558141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:17.559876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:17.560160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:17.560435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.566559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:17.568154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:17.572765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:17.584428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 79/157] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:17 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=440da6136d59483baa79a4c88adb52a0 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:17.588689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 79/158] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:17.655364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:17.684658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:17.763836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0481f9-db5d-49ed-aac5-713c917c01ed None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:17.805557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:17.806379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:17.806658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:17.806932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:17.830334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:17.838548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:17.839505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:17.841126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 80/159] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:17.848806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:17.973662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f041e-7069-43a8-88e0-043ef1208a0a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:18.022413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:18.023102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.023384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.023661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.024424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:18.024756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:18.026154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46546418-583f-48c7-9cae-e0b62f061e6f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:18.036681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 80/160] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:18.042451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:18.054473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031e882-a448-4d08-bdac-acb360bd8731 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.054759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031e882-a448-4d08-bdac-acb360bd8731 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.055037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031e882-a448-4d08-bdac-acb360bd8731 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.058383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 81/161] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:18.064225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3a209-f9d8-4c1c-948d-90f8d53978a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.064548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3a209-f9d8-4c1c-948d-90f8d53978a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.064835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3a209-f9d8-4c1c-948d-90f8d53978a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.091093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e6a3a209-f9d8-4c1c-948d-90f8d53978a6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:18.092464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6a3a209-f9d8-4c1c-948d-90f8d53978a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:18.148889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:18.214750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:18.231629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cdd00-3661-4bb2-a92a-5bace7a3d0eb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:18.233933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 82/162] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:18.254652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a70f-b314-467e-92a9-baebde5445b6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.255161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a70f-b314-467e-92a9-baebde5445b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.255577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a70f-b314-467e-92a9-baebde5445b6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.258441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 83/163] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:18.265944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.266465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.266892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.275761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:18.276791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.277071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.277341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] PATH_INFO: `/v3/users/43433f69b2c244e5a234c2286e9ce5fb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.281165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] RBAC: Authorizing `identity:get_user(user_id=43433f69b2c244e5a234c2286e9ce5fb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:18.282782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:18.288475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 81/164] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/users/43433f69b2c244e5a234c2286e9ce5fb => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:18.288475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:18.293248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:18.294646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:18.423828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d425a-0359-47c7-8a59-145478fd5b1f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:18.446922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 84/165] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:18.447799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:18.472512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:18.473372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.473656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.473932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.499321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:18.517669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:18.518597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 82/166] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:18.519785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:18.566182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:18.643234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:18.653440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c10f-f405-431a-ac41-5bcbf778c94a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:18.733338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:18.733923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.734204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.734476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.762411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d397c2-a74d-417b-8465-c6d63a4c5bd6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:18.846994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:18.853175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:18.854458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:18.854962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:18.855436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:18.860638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:18.877821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:18.897495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:18.898404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:18.899272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:18.902064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 83/167] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:18.903140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:18.984918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:18.996167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 85/168] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:19.001410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.064887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:19.115677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a06e-61b8-4234-a0ab-1a14c308fba7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.124787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77651-9655-41ae-b725-2e524a30f5a5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.164485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.165499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.165923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.166341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.167232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:19.167681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.169239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.184265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 86/169] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.186267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.191757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.192652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.193066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.193493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.194378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:19.194861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.196469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.216307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 84/170] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.217929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.311521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aa9a1-3eea-4153-a9b6-cb2fc25a1b73 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.324811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:19.377912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.378794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.379077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.379349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.381156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.382631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.385301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 87/171] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.387179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.394634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79784a-5d42-4823-be75-e7aa7edea34c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.471384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.472830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.473120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.473394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.477335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.479030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.481303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 85/172] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.482124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.498270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:19.598468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8865-26e3-403b-8608-844ac131ba61 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.644876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:19.666538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.667438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.667717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.667993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] PATH_INFO: `/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.669254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] RBAC: Authorizing `identity:get_user(user_id=6b9362973b5a47cba4f2a0e6e0f1c8f2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.670800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.672803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 88/173] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/users/6b9362973b5a47cba4f2a0e6e0f1c8f2 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.673271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.701748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e3b0-a58d-4088-8388-2e204d92c80a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.742191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.743127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.743353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.743631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.744520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=43433f69b2c244e5a234c2286e9ce5fb) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:19.744835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:19.746949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485c4b3-e4f9-4eaa-bf80-a13f8c783569 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:19.754589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 86/174] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/role_assignments?user.id=43433f69b2c244e5a234c2286e9ce5fb&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:19.755722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64427-4703-4881-adff-279b766f0e73 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.756093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64427-4703-4881-adff-279b766f0e73 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.756276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64427-4703-4881-adff-279b766f0e73 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:19.757518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 87/175] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:19.758203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b64427-4703-4881-adff-279b766f0e73 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:19.837467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:19.886258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b64427-4703-4881-adff-279b766f0e73 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.926854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11523-5dc5-42f4-99b3-95784cad09fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:19.954551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:19.955664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:19.956156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:19.956688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.038080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.039947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea86408-56d1-4c8d-8308-639aa37ad919 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.047655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.048341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.048658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.048938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.117450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.185288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 88/176] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:20.191027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.193678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c17ca-5656-49b7-98cb-089dfa09ad08 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.193995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c17ca-5656-49b7-98cb-089dfa09ad08 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.194306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c17ca-5656-49b7-98cb-089dfa09ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.208878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.211969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cb13a-1578-455d-b01f-7a0989376410 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.221623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d88c17ca-5656-49b7-98cb-089dfa09ad08 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:20.223456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d88c17ca-5656-49b7-98cb-089dfa09ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:20.316534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 89/177] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:20.316534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830964-a164-4123-929e-1796b12c21ae None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.316534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830964-a164-4123-929e-1796b12c21ae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.317043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830964-a164-4123-929e-1796b12c21ae None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.318276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 90/178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:20.318825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a830964-a164-4123-929e-1796b12c21ae None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.348946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 89/179] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:20.350293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9c0f-4b96-43ef-8da4-6054dbd3f467 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.350638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9c0f-4b96-43ef-8da4-6054dbd3f467 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.350922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9c0f-4b96-43ef-8da4-6054dbd3f467 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.352322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 90/180] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:20.353245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.353523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.353795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.377256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:20.378605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:20.428726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.433659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a830964-a164-4123-929e-1796b12c21ae None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.453118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 91/181] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:20.453118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.468152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.469114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.469398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.469702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.470946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.472412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.474193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 91/182] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:20.474943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.480673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.557270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65a3ff-236e-4b82-b8a5-4eb00311c600 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.573043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d982-edd5-4953-874e-7eda53987a40 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.591693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.592578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.592825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.593135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.602990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:20.607208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.608105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.608384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.608691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] PATH_INFO: `/v3/projects/4b6716f45abf4b16b80c58f3807edf80` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.609903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] RBAC: Authorizing `identity:get_project(project_id=4b6716f45abf4b16b80c58f3807edf80)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a89f75b1-2472-41cd-91eb-7fb10e3a6f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:20.610591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:20.611583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:20.617851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:20.618603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d7d0d-2103-42f2-8d1c-53ab14b5003b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.618685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 92/183] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:20.618685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.618824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 92/184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/projects/4b6716f45abf4b16b80c58f3807edf80 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:20.618900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.618900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e182c-d41d-4a7c-88de-dd71cbf76425 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e182c-d41d-4a7c-88de-dd71cbf76425 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e182c-d41d-4a7c-88de-dd71cbf76425 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 93/185] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:20.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e182c-d41d-4a7c-88de-dd71cbf76425 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.633463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:20.634636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:20.657195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.701646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 93/186] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:20.702553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.717518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.727412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e182c-d41d-4a7c-88de-dd71cbf76425 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.760094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.761031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.761315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.761595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.771902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:20.779950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:20.781036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:20.781879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 94/187] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:20.782600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.804212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8091a7-c5dc-4df4-8430-83f681b9e169 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.837694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.838385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.838676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.838953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.839789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:20.840102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.841629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab27a27-04b1-4969-b705-2aad8ac85aa3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.847564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 94/188] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:20.848725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.849014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.849283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.869202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:20.871299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:20.876026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:20.884484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82e31c-6816-4708-8b9e-8549a4905390 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:20.920297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:20.921291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:20.921713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:20.922158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:20.922943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:20.923250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:20.924735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:20.939330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 95/189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:20.939330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.950791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 95/190] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:20.951508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:20.960838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.065500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a136d3-113a-450d-a1ef-2ca96d61a8b0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.078562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4dc5-31d9-4a91-b85f-0950a8748274 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.103586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.104390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.104692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.104962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.112914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411710-718e-4e2d-ace3-40073057970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.113571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411710-718e-4e2d-ace3-40073057970c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.113850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411710-718e-4e2d-ace3-40073057970c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.114124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411710-718e-4e2d-ace3-40073057970c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.114969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db411710-718e-4e2d-ace3-40073057970c None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=4b6716f45abf4b16b80c58f3807edf80, user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:21.115083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:21.115279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db411710-718e-4e2d-ace3-40073057970c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.116755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db411710-718e-4e2d-ace3-40073057970c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.122594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 96/191] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/role_assignments?user.id=6b9362973b5a47cba4f2a0e6e0f1c8f2&scope.project.id=4b6716f45abf4b16b80c58f3807edf80&role.id=440da6136d59483baa79a4c88adb52a0 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:21.122709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:21.123589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:21.124357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:21.124993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411710-718e-4e2d-ace3-40073057970c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.125059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 96/192] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:21.125059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.150632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.210252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.243001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411710-718e-4e2d-ace3-40073057970c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.256479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31112-499e-4fe4-be41-6767f4c3abb1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.288078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.288078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.288078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.288440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.289028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:21.289328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.290788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.299361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.300227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 97/193] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.300686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.300972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.301244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.305401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.318538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.319628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.321406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 97/194] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.322255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.394122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.412799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bf93-8aa6-4b8e-8066-d262e8c813cf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.421754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066c8-6396-4b66-a740-f321c0c877f9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.444143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.444885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.445721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.446007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.446248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.447521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.448963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.450585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 98/195] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.451338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.458528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.459212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.459499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.459775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.460570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:21.460864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.462248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.470867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 98/196] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.471509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.556655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c393-7415-44ab-94d5-91217d74ee19 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.568966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fade5-4f2e-4641-9e1a-22b4ca6018bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.589909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.590802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.591082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.591370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.592776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.594260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.595910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 99/197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.597619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.601531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.602252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.602536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.602812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.617116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.654903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.669603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.671168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.693844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44e05-54fc-4050-94c6-e655254f440a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.731238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.731922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.732208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.732607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.733333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.734853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.755333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 100/198] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:21 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:21.756152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.782760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 99/199] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:21.784064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.846497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.874588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234edb-8b1d-4e94-8dd9-12bff0b5c943 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.887674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:21.907147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108cafd-ef91-45ab-9c2b-5e16ec3cbaa4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:21.913942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.914853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.915136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.915416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] PATH_INFO: `/v3/users/f5b6501746a946e1946240378bce5165` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:21.916653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b6501746a946e1946240378bce5165)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:21.918162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:21.919915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 101/200] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/users/f5b6501746a946e1946240378bce5165 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:21.925283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:21.952256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:21.953790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:21.954072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:21.954347 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.035926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.037052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b193ca-5116-4884-b9bd-66a84a5580d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.037464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.082586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.083835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.084110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.084380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.087155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.089838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.090605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 102/201] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:22.095718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.111632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.136885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.158501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 100/202] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:22.159750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.232638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650e22-d70f-497a-afc6-fb3668b2b4ea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.269126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.269974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.270376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.270828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.276901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940949-4356-47fa-bc5f-76992cee3c08 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.313144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.314098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.314616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.315027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.316103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=e13f63cfa0d04cf0a95700e52fa77554) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:22.316569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.318286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.328736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 101/203] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/role_assignments?user.id=e13f63cfa0d04cf0a95700e52fa77554&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:22.329976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.345097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.346875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.364592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.428851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.520876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 103/204] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:22.524512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684bf9c-2c0a-4d8e-8aa8-27760080dc2f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.526939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.564488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356958-28d9-4455-a592-4c618416acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.565412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356958-28d9-4455-a592-4c618416acbd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.565694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356958-28d9-4455-a592-4c618416acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.565970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356958-28d9-4455-a592-4c618416acbd None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.568187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356958-28d9-4455-a592-4c618416acbd None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.569704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356958-28d9-4455-a592-4c618416acbd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.573172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 102/205] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:22.577100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356958-28d9-4455-a592-4c618416acbd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.677119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660969-111c-461d-a665-4f52ea8d64d0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.694166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.751807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356958-28d9-4455-a592-4c618416acbd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.761165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.762065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.762351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.762637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.763871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.765424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.767467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 104/206] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:22.773506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:22.780303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:22.795418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.796474 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.796994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.797469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:22.798593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=e13f63cfa0d04cf0a95700e52fa77554) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:22.799108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:22.800970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce8fdf-c961-41ea-a645-92fcaab3e4ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:22.807346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 103/207] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/role_assignments?user.id=e13f63cfa0d04cf0a95700e52fa77554&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:22.945451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3bf-63d7-4de8-8988-6b65cc0ac519 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:22.998293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:22.998946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:22.999228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:22.999503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:23.000348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc, user.id=f5b6501746a946e1946240378bce5165) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:23.000697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:23.002166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce131-f0f7-40e8-a193-0aabe937a45f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:23.009141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 105/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:22 2022] GET /identity/v3/role_assignments?user.id=f5b6501746a946e1946240378bce5165&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:24.020793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1440-db25-446e-8170-8d233febf72e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.021355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1440-db25-446e-8170-8d233febf72e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.021355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1440-db25-446e-8170-8d233febf72e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.022857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 104/209] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:24.030130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.030130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.030130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.046167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:24.047663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:24.082743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.092172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bade-a480-4930-bf17-0bc77935ce36 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.092823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bade-a480-4930-bf17-0bc77935ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.093357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bade-a480-4930-bf17-0bc77935ce36 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.095009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 105/210] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:24.100875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.101507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.101973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.119847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 106/211] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:24.120801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:24.122292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:24.151637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.191004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 106/212] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:24.216501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.287168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd5ab3-c166-4271-b521-e1a40b573216 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.330678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa54d-df3e-42e9-ae7b-5a86cbfffcfa None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.331007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.331992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.332672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.334330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.347150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.347530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:24.359769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:24.360837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:24.361612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:24.362714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 107/213] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:24.367637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.375391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.376486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.376965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.377427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.378800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:24.380501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:24.386834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 107/214] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:24.388175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.400399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.476920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a28-a966-4b0c-a12a-7c2deafab6d3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.495398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc223a-b391-4841-b779-7a196ece3088 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.517453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.518155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.518444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.518727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.519488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:24.519794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:24.521379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:24.533050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.534070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.534562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.535229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.535471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 108/215] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:24.536353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:24.536485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.538319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee626-184b-4199-a89f-c096372a2ba1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:24.562293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 108/216] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:24 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 15:59:24.644729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.652815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f808-d3f0-465a-9f40-2d341cc7200f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.658523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b585-fb96-45a8-85b6-a6fd3c663f4e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.659093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b585-fb96-45a8-85b6-a6fd3c663f4e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.659546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b585-fb96-45a8-85b6-a6fd3c663f4e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.661576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 109/217] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:24.667028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.667302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.667590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.685143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:24.686387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:24.690391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.691325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.691611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.691895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] PATH_INFO: `/v3/users/3d9c93781b3c49e79e82c70ac61fa079` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.713854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9c93781b3c49e79e82c70ac61fa079)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:24.715778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:24.717975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 109/218] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/users/3d9c93781b3c49e79e82c70ac61fa079 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:24.730351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.730701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.777547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 110/219] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:24.802767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:24.853846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c240c-a324-4d1f-9520-39621a95c519 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.895869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.896624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.896909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.897191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.923833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:24.930109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3def3-f519-44e0-a9dc-c479e6d889b9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:24.974936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:24.975770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:24.976050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:24.976327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:24.982756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:24.984599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47920dbf-96f3-44ca-8ee5-967ea3988c59 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:24.989184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:24.997689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:24.998830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:24.999790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:25.002046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:25.008511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.044931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.114401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 110/221] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:25.121104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b7a4-0eea-4f33-a3fe-bd42c2e6909e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.121337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b7a4-0eea-4f33-a3fe-bd42c2e6909e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.121609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b7a4-0eea-4f33-a3fe-bd42c2e6909e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.123127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 111/222] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:25.124007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b7a4-0eea-4f33-a3fe-bd42c2e6909e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.138068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6d9b-6477-4859-bfc1-64e2d3f45b47 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.173903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.174789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.174898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.175136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.175907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:25.176218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.177799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9f2b-2541-4a37-af43-637dc436efcb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.187720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 112/223] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:25.192431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.192431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.192431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.195828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.208857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:25.210341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:25.256049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b7a4-0eea-4f33-a3fe-bd42c2e6909e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.278033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 113/224] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:25.279105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.297573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.299601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.300791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.300791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.301058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.304488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.306295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.308507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:25.314276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.381830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1daccf-026b-42c4-8f53-e76a40f67811 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.416850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.417748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.418035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.418311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.419523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.421101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.423124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:25.423903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.431321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84707-ee89-4e68-8e69-a1cb4dda7a82 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.454345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.477459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.481338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.481338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.481338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.499989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:25.508199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:25.509136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:25.509924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:25.510562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.526516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.552658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52618f-0364-4068-85ac-a6cda1974eb0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.599963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.601470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.601758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.602035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.602884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=3d9c93781b3c49e79e82c70ac61fa079) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:25.603199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.604759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.610608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/role_assignments?user.id=3d9c93781b3c49e79e82c70ac61fa079&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=440da6136d59483baa79a4c88adb52a0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:25.611504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.629111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764887f-c4a8-4b30-abe2-e52d993f5fc5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.680532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.682164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.682895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.683888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.685848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.688741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.690758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:25.697605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.761376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:25.802738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24178a-4dec-404c-949b-2ef7164e6efb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.826032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b321b-35bf-4fa8-9bb7-0b03e2498caa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:25.869180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.869870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.870154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.870434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.871228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:25.871500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.872274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:25.872937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.873768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:25.874548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:25.875047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/e13f63cfa0d04cf0a95700e52fa77554/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:25.877668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, user_id=e13f63cfa0d04cf0a95700e52fa77554, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:25.880362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:25.882136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 116/230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:25.888091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:25.904135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 115/231] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:25 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/e13f63cfa0d04cf0a95700e52fa77554/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:25.918782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:26.066104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c8bc-02d0-42f5-a560-b44d5d213cfb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:26.108192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:26.109500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:26.109984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:26.110460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:26.111881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:26.113606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:26.115501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 117/232] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:25 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:26.121491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:26.231160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7526ed-b6a0-4bb3-b184-0be52dd22b97 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:26.240323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:26.268560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:26.269512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:26.269797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:26.270172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:26.271384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:26.272909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596a15-96bc-408f-bda1-deded8f43476 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:26.274813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 116/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:26 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:26.280362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:26.367437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:26.387955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a64f3c-c742-401a-9e26-57850814e987 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:26.422679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:26.423601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:26.423891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:26.424175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/e13f63cfa0d04cf0a95700e52fa77554/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:26.426445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, user_id=e13f63cfa0d04cf0a95700e52fa77554, role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:26.428061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a2191-cd16-45ac-8499-c513e5a79c24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:26.443165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 118/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:26 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/e13f63cfa0d04cf0a95700e52fa77554/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:27.071350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c300be-45ab-47a0-81ec-2317ced8269e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.071744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c300be-45ab-47a0-81ec-2317ced8269e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.071941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c300be-45ab-47a0-81ec-2317ced8269e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.073346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 117/235] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:27.081237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.081701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.081877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.110053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:27.111250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:27.125937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518664c-a2b2-447e-b92b-b64343393374 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.126457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518664c-a2b2-447e-b92b-b64343393374 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.126457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518664c-a2b2-447e-b92b-b64343393374 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.127875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 118/236] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:27.133508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.133801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.134081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.155910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:27.157177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:27.239012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 119/237] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:27.247944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:27.262639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:27.311853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:27.428976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:27.454898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da521d7-cfc4-4e01-b0f2-8c05434ea35a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:27.491269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133541a-a9a5-4472-aed9-5b46a37a3d43 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:27.501510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:27.502334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.502618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.502899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.504070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:27.505582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:27.507401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:27.512834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 120/239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:27.515505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:27.581176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:27.582003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.582278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.582551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.603880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:27.620096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:27.621285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:27.622165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:27.627349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:27.672481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7eeda-a796-49af-9492-0d3c38cfb051 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:27.755824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:27.756930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.757220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.757502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.758234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:27.759703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:27.793466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:27.832905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 121/241] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:27 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 15:59:27.889732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80355683-2902-4a58-9179-1f9ec3b8644a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:27.964387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:27.966271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:27.966557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:27.966840 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:27.967708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:27.968017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:27.971566 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.000213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 121/242] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:28.014202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.158023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998aad0-dabf-4df2-85e2-f9526e9b0a60 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.194093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.194994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.195282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.195574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] PATH_INFO: `/v3/users/a470e2268d0749ff85fb12681cc8e7bb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.212762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] RBAC: Authorizing `identity:get_user(user_id=a470e2268d0749ff85fb12681cc8e7bb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:28.214285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b162f6-85b7-49e8-bbc0-dffff2dee4bd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.216138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 122/243] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/users/a470e2268d0749ff85fb12681cc8e7bb => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:28.223487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.254607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.258656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5627-0824-448f-a408-3e2c326dcafa None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.258946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5627-0824-448f-a408-3e2c326dcafa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.259623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5627-0824-448f-a408-3e2c326dcafa None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.261314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 123/244] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:28.266607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.266835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.267120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.286184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:28.286367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:28.347271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.367758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457feeb7-34fb-4bf9-ae61-7261c232aad9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.376720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:28.401182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.409843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.410526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.411317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.411317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.500970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:28.502697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.539261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.542686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609b4c-b9f5-4c0b-abb9-35396e3dea13 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.590060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.592004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.592395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.593018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.608944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:28.619515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:28.620404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:28.621324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 125/246] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:28.626873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.632634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 122/247] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:28.642414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.686853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.765327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc0a51-5c75-491a-a049-f7bc19166ad6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.779330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaca5-9cbf-4567-98bd-b5b99e890ea1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.801127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.802159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.802643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.803114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.804072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:28.804650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:28.806277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de5d2-0721-49da-853a-82c66c97c92c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.815351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 126/248] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:28.816984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e467b-d69c-4a6d-9975-3749b1784498 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.817476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e467b-d69c-4a6d-9975-3749b1784498 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.817952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e467b-d69c-4a6d-9975-3749b1784498 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.819658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 127/249] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:28.821008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e467b-d69c-4a6d-9975-3749b1784498 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:28.849532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.863022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.863917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.864203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.864495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.865696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:28.867180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93568-2571-4ba8-8400-750952dce7c4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.881437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 123/250] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:28.882901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223458-d619-4084-8fbe-b139ade0606a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.883106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223458-d619-4084-8fbe-b139ade0606a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.883363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223458-d619-4084-8fbe-b139ade0606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.920423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-17223458-d619-4084-8fbe-b139ade0606a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:28.921665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-17223458-d619-4084-8fbe-b139ade0606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:28.938649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e467b-d69c-4a6d-9975-3749b1784498 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:28.946754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:28.975918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:28.976957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:28.977319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:28.977669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] PATH_INFO: `/v3/users/3d9c93781b3c49e79e82c70ac61fa079` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:28.978956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] RBAC: Authorizing `identity:get_user(user_id=3d9c93781b3c49e79e82c70ac61fa079)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:28.980580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:28.982695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 128/251] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/users/3d9c93781b3c49e79e82c70ac61fa079 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:28.983731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.086703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7dd5-5b15-47cb-912a-97931feb497e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.116161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 124/252] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:29.116968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223458-d619-4084-8fbe-b139ade0606a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.128713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.129396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.129667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.129947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.130809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=a470e2268d0749ff85fb12681cc8e7bb) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:29.131129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:29.132633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:29.142521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 129/253] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:28 2022] GET /identity/v3/role_assignments?user.id=a470e2268d0749ff85fb12681cc8e7bb&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:29.174972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.226418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:29.301148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528584f-b64e-4f99-9e15-920c703f0944 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.305449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223458-d619-4084-8fbe-b139ade0606a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.345794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:29.356042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.356914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.357211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.357512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.359255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.360367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.360869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.361345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.362717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:29.364367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e59de-8a54-4a1e-8c94-0fbe167a48e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:29.367626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 125/254] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:29.369308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d12821-a7b6-4650-9159-51a8dc9ba964 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.369783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d12821-a7b6-4650-9159-51a8dc9ba964 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.370242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d12821-a7b6-4650-9159-51a8dc9ba964 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.371697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 126/255] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:29.379969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.380913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.381206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.383103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:29.392432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:29.393352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:29.394126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:29.396833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 130/256] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:29.397935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.398036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:29.403176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:29.474697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 127/257] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:29.475630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.532484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:29.540356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a327-6237-414a-a750-ddf36ca8df14 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.585961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.586876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.587160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.587434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/3d9c93781b3c49e79e82c70ac61fa079/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.590650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, user_id=3d9c93781b3c49e79e82c70ac61fa079, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:29.592338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:29.624559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 131/258] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:29 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/3d9c93781b3c49e79e82c70ac61fa079/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:29.625439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.685444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf5a2-d654-4367-88b9-936935b2468a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.755677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:29.782058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.782764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.783042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.783312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.784093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:29.784400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:29.786984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:29.813043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 128/259] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:29.819520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.828673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6454b-24c1-470b-8b36-c12a61d37e83 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:29.871624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:29.872669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:29.873287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:29.873668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:29.887270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:29.896843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:29.897858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:29.898721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:29.899325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 132/260] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:29.904588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:29.940117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:30.017586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967715-7979-4fb5-b069-c0650f8a3b91 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.080286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.081626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.082219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.082663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.089112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.091231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.093857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 129/261] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:30.098837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:30.099860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8c9f-0351-4f41-8132-b180045bcb18 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.169878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.170670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.170955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.171230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.171992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:30.172298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.173740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.195276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 133/262] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:30.199999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:30.200801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:30.273231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37592c32-333f-4ab2-ab8d-6a0b4964bda9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.301512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:30.313939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2175-fb9b-4cf7-83d1-80cefc957f80 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.338619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.339422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.339749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.340030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.352624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.353845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.354318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.354782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] PATH_INFO: `/v3/users/e13f63cfa0d04cf0a95700e52fa77554` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.356174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e13f63cfa0d04cf0a95700e52fa77554)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.358110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.360395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 134/263] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/users/e13f63cfa0d04cf0a95700e52fa77554 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:30.365906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:30.474938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.476664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.562661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03ad8-9320-46f7-977d-1de91e3624f6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.567093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:30.631327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 15:59:30.639771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:30.651140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.651816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.652102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.652384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.681296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:30.762708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.764315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.855816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b16f5-c9bf-4b08-a658-eb7f32d9d825 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:30.918150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 135/265] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:30.924624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:30.935245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:30.936618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:30.937093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:30.937555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:30.941106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:30.942860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:30.946988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 131/266] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:30.953214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.002878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.016060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.127814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3bcc-cedf-4bed-880d-7a6cc5e332ca None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.165291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.166248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.166779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.167200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.168189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=e13f63cfa0d04cf0a95700e52fa77554) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:31.168676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:31.170475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654123-307d-47fe-847a-0f4ddebd354c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:31.177064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 132/267] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/role_assignments?user.id=e13f63cfa0d04cf0a95700e52fa77554&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:31.178591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4c637-dfb5-471f-970a-205b3c643e37 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.184492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4c637-dfb5-471f-970a-205b3c643e37 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.185112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4c637-dfb5-471f-970a-205b3c643e37 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.186873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 133/268] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:31.190340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6726c6-15db-43b4-a6ac-2ca351eda3fc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.192988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.193462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.193916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.221910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:31.223559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:31.313614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 134/269] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:31.315527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.316427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.316749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.317025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.320333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:31.321899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:31.328220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 136/270] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:30 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:31.329518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.349892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.355319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.490544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9d7e0-98d4-42bd-b0f2-6e604ada8119 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.539226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.539843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51943a06-7a35-4725-9858-afec248007a3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.540155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.540558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.540925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.542016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=e13f63cfa0d04cf0a95700e52fa77554) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:31.543223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:31.545026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3ff2-4146-4411-94ae-31d2d0960fda None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:31.552371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 135/271] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:31 2022] GET /identity/v3/role_assignments?user.id=e13f63cfa0d04cf0a95700e52fa77554&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:31.554116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dc11-d37b-4087-b742-7230f6d125e8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.554493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dc11-d37b-4087-b742-7230f6d125e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.555011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dc11-d37b-4087-b742-7230f6d125e8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.555836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.556485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 136/272] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:31.564101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.564460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.565035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.585296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.586118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.586401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.586676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.587231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:31.588600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:31.602651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:31.611210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:31.613327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:31.615236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 137/273] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:31.626806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.675643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 137/274] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:31.719636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.735707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.854422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a2e4-efb0-4524-9554-c5843e5b2aad None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.854781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc2eb-53ba-4ceb-9ced-68f73ff48661 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:31.891928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.892653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.892938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.893211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.893962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:31.894269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:31.895730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:31.896337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:31.897337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:31.897623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:31.897891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:31.899417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:31.900905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:31.903028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 138/275] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:31.906874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 138/276] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:31.914501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.914640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:31.952808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:31.999261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.022803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff165b-e32a-4861-9b83-5cf1c0d45882 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.024248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b770a2-18e2-466c-8a39-08667071b51c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.059025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.059706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.059984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.060257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.061046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.062498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e87520-a850-4d90-88e4-c291a31ac7f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.062995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.064712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.065208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.065668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] PATH_INFO: `/v3/users/bde611e648ab43c59730929d2a5d2c39` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.082541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] RBAC: Authorizing `identity:get_user(user_id=bde611e648ab43c59730929d2a5d2c39)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.086014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.087379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 139/277] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:31 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 15:59:32.088641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 139/278] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:31 2022] GET /identity/v3/users/bde611e648ab43c59730929d2a5d2c39 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:32.093374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f2c5-37e8-4746-95c5-7c2763200a48 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.094493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.095177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f2c5-37e8-4746-95c5-7c2763200a48 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.095452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f2c5-37e8-4746-95c5-7c2763200a48 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.097283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 140/279] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:32.103260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.103675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.104081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.127374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:32.129019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:32.220689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 141/280] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:32.231036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.243755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.246748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19344-94f7-4e58-8c71-0b902e853de7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.286116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.286804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.287088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.287369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.288216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, user.id=bde611e648ab43c59730929d2a5d2c39, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:32.288562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.290523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba058d1-a6cd-4914-b6b3-6b14cd754710 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.296932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 140/281] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/role_assignments?user.id=bde611e648ab43c59730929d2a5d2c39&scope.system=all&role.id=440da6136d59483baa79a4c88adb52a0 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:32.298338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a3c5-fe08-4efa-b5fc-26e1a710dccc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.298630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a3c5-fe08-4efa-b5fc-26e1a710dccc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.298909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a3c5-fe08-4efa-b5fc-26e1a710dccc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.300180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 141/282] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:32.306232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.306516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.306794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.327621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:32.328921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:32.330836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.382409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559003ea-9477-4cea-a2ea-6975a6955ebf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.411845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 142/283] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:32.430716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.431942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.432411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.432943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.436389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.448836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:32.459772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:32.460818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:32.461596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:32.462190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 142/284] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:32.469478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.567136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.585692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468278-795b-4da0-905c-44bf67d76bd8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.609464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6faaf-8727-434e-b941-270926a0d2e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.631755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.632683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.632908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.633189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.639213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.649452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:32.651506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.652285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.652707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.653184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.654451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:32.654895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.656402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:32.657776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:32.658664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:32.659452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:32.660042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 143/285] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:32.665713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.672532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 143/286] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:32.676431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.831829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a0b4b-ddb0-4587-8b3d-ce0ca73b569b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.858204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e912-fad6-4104-91a7-5bea1c123017 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:32.873824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.874517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.874801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.875079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.875847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:32.876156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.877614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.887012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 144/287] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:32.893787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:32.912781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:32.938688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:32.939600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:32.939884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:32.940164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] PATH_INFO: `/v3/users/a470e2268d0749ff85fb12681cc8e7bb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:32.942050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] RBAC: Authorizing `identity:get_user(user_id=a470e2268d0749ff85fb12681cc8e7bb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:32.943540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:32.945223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/users/a470e2268d0749ff85fb12681cc8e7bb => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:32.952401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:33.042078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:33.073029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c1861-c480-474f-9d9d-d312b893f742 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.091479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb072a-c301-4d2e-9e4c-2c9d2a0ec16b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.126146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.127023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.127304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.127587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.128811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.130290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.132320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 145/289] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:33.138120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:33.142506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.143404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.143686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.143963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] PATH_INFO: `/v3/users/3d9c93781b3c49e79e82c70ac61fa079` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.149195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9c93781b3c49e79e82c70ac61fa079)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.150683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.152727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 145/290] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:32 2022] GET /identity/v3/users/3d9c93781b3c49e79e82c70ac61fa079 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:33.159247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:33.248673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9efb-a457-47bf-b428-d21c2ce73f51 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.273776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:33.286349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.287406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.287695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.287976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/a470e2268d0749ff85fb12681cc8e7bb/roles/403f6c908b7c4e4d806ee567232b1ba5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.289977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, user_id=a470e2268d0749ff85fb12681cc8e7bb, role_id=403f6c908b7c4e4d806ee567232b1ba5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.291436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.305619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:33.317504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 146/291] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 15:59:33 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/users/a470e2268d0749ff85fb12681cc8e7bb/roles/403f6c908b7c4e4d806ee567232b1ba5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 15:59:33.329209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9051-a006-4c0c-9182-5ad05dfeda11 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.367079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.367788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.368032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.368317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.441531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.442942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.525889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:33.553543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 146/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:33.562004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:33.706425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9061-b3d9-44c0-8861-4d215bb9b23d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.741388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.742274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.742556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.742834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.744023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.745536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86555d-c6ae-4d9d-b611-54611f7b9ae9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.747573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 147/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:33 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:33.753489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:33.876111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e16-e9ef-46cf-9ae3-7aafeddc27fd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:33.933709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:33.934375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:33.934657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:33.934928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:33.935824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=3d9c93781b3c49e79e82c70ac61fa079) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:33.936134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:33.937605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f835c72-4c15-41ff-9ee3-151c42ec581a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:33.945442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 147/294] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:33 2022] GET /identity/v3/role_assignments?user.id=3d9c93781b3c49e79e82c70ac61fa079&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=440da6136d59483baa79a4c88adb52a0 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:34.574864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63687-783d-4c02-84fc-d05812239299 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.575819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63687-783d-4c02-84fc-d05812239299 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.576359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63687-783d-4c02-84fc-d05812239299 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.578215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 148/295] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:34.584082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.584947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.585410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.603826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:34.605364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:34.633918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ec7e-438c-4780-87a2-1819d81d2a0e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.634204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ec7e-438c-4780-87a2-1819d81d2a0e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.634646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ec7e-438c-4780-87a2-1819d81d2a0e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.636032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 149/296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:34.642986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.643268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.643546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.654762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:34.669658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:34.670910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:34.698641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 148/297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:34.722391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:34.726799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:34.753937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 150/298] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:34.776422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:34.831232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58fa81-7aac-45ef-8c63-4a7c054923ac None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:34.870270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:34.871574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.871854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.872129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.883447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a438c2ea-1618-4c6d-9c45-e91181fc4040 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:34.892211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:34.893358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 149/299] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:34.899269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d9-de4f-4523-9dbf-d28efba5f6b0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.899974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d9-de4f-4523-9dbf-d28efba5f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.899974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d9-de4f-4523-9dbf-d28efba5f6b0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.899974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 150/300] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:34.900146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb04d9-de4f-4523-9dbf-d28efba5f6b0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:34.904600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14877c6-f84d-4157-8284-a5005ae1c448 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:34.935370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:34.940335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:34.941761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.941761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.941761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.952900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1a37baaa-c678-4301-bc0e-e034f4e43b97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:34.960963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:34.961839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 151/301] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:34.967945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:34.968891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:34.968891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:34.983607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:34.984822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:35.017255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb04d9-de4f-4523-9dbf-d28efba5f6b0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.018847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.052939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 152/302] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:35.053598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.061381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.062337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.062814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.063304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.064835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:35.065348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.067756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.078816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 151/303] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:35.080102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.163023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286eb11-b88e-4ecb-bd79-f8e1503d92b4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.176698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.184268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7dc47-c5f2-4d90-88a6-f4b1f62bbefb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.199887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.200956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.201475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.201957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.203059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:35.203617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.205315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.214913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 153/304] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:35.215986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.224356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.225323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.225609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.225889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.227054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.228531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.230314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 152/305] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:35.234951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.248946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.321914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9decb-1133-4cb9-81e1-21d2921cf89b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.335234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792223-a1d1-42d7-b124-886a6f63f2cf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.358187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.359022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.359472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.359577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] PATH_INFO: `/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.370392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.371299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.371556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.371830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] PATH_INFO: `/v3/users/bde611e648ab43c59730929d2a5d2c39` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.373111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=bde611e648ab43c59730929d2a5d2c39)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.373948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=55200e86dde345d09e1f5aa7bdd5c0d7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.374575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.375404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.376439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 153/306] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/users/bde611e648ab43c59730929d2a5d2c39 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:35.376998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.386045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 154/307] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:35.386045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.411335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.479880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.490517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036645-3e17-4c93-b6fe-42f5b0c45fc0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.507574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26406-081e-4226-85f1-4661820e2bb7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.524629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.525516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.525799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.526080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] PATH_INFO: `/v3/system/users/bde611e648ab43c59730929d2a5d2c39/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.527560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bde611e648ab43c59730929d2a5d2c39, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.529016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.540378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 155/308] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jul 5 15:59:35 2022] PUT /identity/v3/system/users/bde611e648ab43c59730929d2a5d2c39/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:35.541260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:35.567469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.568776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.569282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.569841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.570962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.573865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804f79-6e36-414d-a10c-d3c056ac73db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.597726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 154/309] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jul 5 15:59:35 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:35.684032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d3c71-10d8-416d-a8ae-72f127277a54 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:35.728335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:35.729070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.729354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.729633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.730487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, user.id=55200e86dde345d09e1f5aa7bdd5c0d7, scope.system=all) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:35.730833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:35.732478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd10cc-b97f-4d81-9667-d4d3bd742cc4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:35.738704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 156/310] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/role_assignments?user.id=55200e86dde345d09e1f5aa7bdd5c0d7&scope.system=all&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:35.800826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdb5d-cb9f-478d-8c85-74d36dea9524 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.801166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdb5d-cb9f-478d-8c85-74d36dea9524 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.801401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdb5d-cb9f-478d-8c85-74d36dea9524 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.803124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 155/311] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:35.808973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:35.809289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:35.809566 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:35.831889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:35.834420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:35.852830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:35.919387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 157/312] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:35.942448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cdb5d-cb9f-478d-8c85-74d36dea9524 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:36.047540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:36.059839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cdb5d-cb9f-478d-8c85-74d36dea9524 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:36.100352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:36.101123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:36.101410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:36.101694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:36.114263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:36.123834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:36.124791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:36.126029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 156/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:36.131654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:36.235614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5d9dd-cd93-42d3-a701-651793c27ee1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:36.272320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:36.273039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:36.273326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:36.273600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:36.274351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:36.274656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:36.276043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:36.285317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 158/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:36.291505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:36.403193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1ca0-8612-4d30-b5b3-3b5f13a8e7b1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:36.467507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:36.469608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:36.470437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:36.471255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] PATH_INFO: `/v3/users/a470e2268d0749ff85fb12681cc8e7bb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:36.473953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] RBAC: Authorizing `identity:get_user(user_id=a470e2268d0749ff85fb12681cc8e7bb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:36.477156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:36.481210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 157/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:36 2022] GET /identity/v3/users/a470e2268d0749ff85fb12681cc8e7bb => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:36.492223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:36.516000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:36.632279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47c07-d4d1-435e-801b-cc2999c16e0b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:36.666285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:36.666873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:36.667157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:36.667438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:36.744392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:36.745895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:36.759111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:36.855808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 159/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:36.861945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:36.897318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:36.973409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af61e1-4ee1-44b6-b67c-0befe72ed731 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:37.008686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:37.009937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.010418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.010912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.012306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:37.014037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d503-e7fd-4080-ab7c-e2e5a675b225 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:37.016263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 158/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:36 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:37.022408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:37.120742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15ac2-a441-4ea1-9547-83886de2b7da None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:37.132631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:37.157385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:37.158052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.158333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.158609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.159444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, scope.project.id=1a9b2ea932954cd3b935743cc04547e4, user.id=a470e2268d0749ff85fb12681cc8e7bb) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:37.159757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:37.161243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d64bdd-48fb-4346-981c-0e2662a13f14 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:37.167644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 160/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 15:59:37 2022] GET /identity/v3/role_assignments?user.id=a470e2268d0749ff85fb12681cc8e7bb&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:37.734129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2c2a-cfc6-4c6e-a400-942accbcfb0a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.734457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2c2a-cfc6-4c6e-a400-942accbcfb0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.734620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2c2a-cfc6-4c6e-a400-942accbcfb0a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.736171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 159/319] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:37.742475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6b12-18b7-42e7-bbdf-a14ced436365 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.742795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6b12-18b7-42e7-bbdf-a14ced436365 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.743093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6b12-18b7-42e7-bbdf-a14ced436365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.761327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b91f6b12-18b7-42e7-bbdf-a14ced436365 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:37.762508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b91f6b12-18b7-42e7-bbdf-a14ced436365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:37.820761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179582d-a10e-47a9-b92b-d3a3e1414123 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.821062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179582d-a10e-47a9-b92b-d3a3e1414123 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.821436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179582d-a10e-47a9-b92b-d3a3e1414123 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.822996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 160/320] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:37.827875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.828169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.828465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.840470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 161/321] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:37.843775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddd83-ad2b-4a47-aefa-726e7e9f14da None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.844066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddd83-ad2b-4a47-aefa-726e7e9f14da None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.844346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddd83-ad2b-4a47-aefa-726e7e9f14da None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.845878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 162/322] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:37.846593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:37.847816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:37.851078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:37.851369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:37.851625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:37.867930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:37.869137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:37.918053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 161/323] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:37.918699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:37.933534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 163/324] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:37.940070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:37.940215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:37.974474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.023181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810fdd-e291-44d9-b799-5d36fc73ea4f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.037234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35dd7f-af59-4384-b065-dbeb82dee06f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.058111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.058960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.059237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.059773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.060706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.062180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.063804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 162/325] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:38.069134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.069969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.070782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.071066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.071344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.081588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:38.089677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:38.090730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:38.091583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 164/326] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:38.092263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.155966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.173244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729245fd-daa1-437d-9012-0118ffc26e17 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.182149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.189318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5a7d3-13df-4cac-9590-65992bb9bea3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.207124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.207927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.208602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.208872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.219264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:38.223048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.223722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.224008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.224288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] PATH_INFO: `/v3/groups` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.225013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.226479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:38.226870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:38.227876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 163/327] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:38.228895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.245936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 165/328] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jul 5 15:59:38 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:38.246755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.359866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf97e2-e654-47f1-a3ad-5369e458e5e5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.371239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77728a-9a74-4601-811b-226c82643ae2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.399062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.399754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.400035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.400316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.401091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:38.401397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.402810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.408927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.409646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.409932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.410211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.410974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:38.411281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.412771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.413751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 166/329] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:38.419006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.422711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 164/330] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:38.428282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.439309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.441341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.560064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc01c-b283-4e68-9aef-a23a0865f377 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.563845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1b7a-997d-4033-bd84-4f623abacdbd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.606464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.607503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.607854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.608200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] PATH_INFO: `/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.609477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] RBAC: Authorizing `identity:get_user(user_id=55200e86dde345d09e1f5aa7bdd5c0d7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.611289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.613249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 165/331] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:38.616042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.622173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.622173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.622173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] PATH_INFO: `/v3/users/bde611e648ab43c59730929d2a5d2c39` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.622173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] RBAC: Authorizing `identity:get_user(user_id=bde611e648ab43c59730929d2a5d2c39)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.622173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.622550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 167/332] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/users/bde611e648ab43c59730929d2a5d2c39 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:38.623715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.627879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:38.728972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.735830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:38.753697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd73f3-aa3e-47fa-b873-683045c3cd4e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.758544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1e49-7b40-4ca7-bff0-1b8b2c455b3b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:38.790372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.791028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.791508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.791951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.793127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] RBAC: Adding query filter params (role.id=440da6136d59483baa79a4c88adb52a0, user.id=bde611e648ab43c59730929d2a5d2c39, scope.system=all) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:38.793676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.795131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:38.795569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54280-8284-4e6d-9765-eafcce200804 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.796368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:38.796819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:38.797256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] PATH_INFO: `/v3/system/users/55200e86dde345d09e1f5aa7bdd5c0d7/roles/403f6c908b7c4e4d806ee567232b1ba5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:38.798925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=55200e86dde345d09e1f5aa7bdd5c0d7, role_id=403f6c908b7c4e4d806ee567232b1ba5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:38.800488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfd2e6-691f-4756-a602-634eab175b00 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:38.812871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 168/333] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 5 15:59:38 2022] GET /identity/v3/role_assignments?user.id=bde611e648ab43c59730929d2a5d2c39&scope.system=all&role.id=440da6136d59483baa79a4c88adb52a0 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:38.817041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 166/334] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jul 5 15:59:38 2022] PUT /identity/v3/system/users/55200e86dde345d09e1f5aa7bdd5c0d7/roles/403f6c908b7c4e4d806ee567232b1ba5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:40.746769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07344ab-a0d0-4769-b312-698e75f1b537 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:40.747371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07344ab-a0d0-4769-b312-698e75f1b537 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:40.747371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07344ab-a0d0-4769-b312-698e75f1b537 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:40.749483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8899-5825-4984-9d1e-f99b394d7c19 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:40.749864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8899-5825-4984-9d1e-f99b394d7c19 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:40.750038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8899-5825-4984-9d1e-f99b394d7c19 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:40.751824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 169/336] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:40.751932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 167/336] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:40.754950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:40.755242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:40.755532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:40.759750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:40.760044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:40.760321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:40.799491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:40.800731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:40.803607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:40.804791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:40.936784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 170/337] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 15:59:40.939780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 168/338] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:40.973201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:40.978699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.148018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.152948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.212827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b487426-2589-4f0a-b84e-ec7cf6d055f9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.230989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2237b-1b48-46d8-a0d0-ba5e4a1c6e42 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.270615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.271469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.271757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.272055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.291413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f4c9e005-7fe9-47df-873b-97095ae2ccaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:41.299933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:41.300845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:41.301630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:41.302223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 171/339] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:41.303271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49710-f4dd-4c24-a5de-47e74295b8b7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.303568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49710-f4dd-4c24-a5de-47e74295b8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.303856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b49710-f4dd-4c24-a5de-47e74295b8b7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.305176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 172/340] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:41.310430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b49710-f4dd-4c24-a5de-47e74295b8b7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.326608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.327461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.327744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.328016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.345810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b889cfa2-31e8-462f-8df9-b55c0cd83792 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:41.357894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:41.358812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:41.359594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:41.367721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 169/341] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:41.369265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.369755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.370238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.393513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:41.395073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:41.496947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b49710-f4dd-4c24-a5de-47e74295b8b7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.534346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.536645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 170/342] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:41.537608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.539531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.540221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.540617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.541081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.541869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:41.542183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:41.543651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:41.555449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 173/343] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:41.560795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.645102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.678802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f9b38-2722-442f-8bc8-10fa387f389b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.709789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03e5c-fcf6-4170-b7f1-e5ab93c5ab36 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.723040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.723713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.723996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.724272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.753193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.754733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.755232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.755693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.756717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:41.757214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:41.758798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:41.775989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 171/344] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:41.777252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.801955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.811915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:41.814122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb4c75-2f23-417e-9bf2-d283f1ae05ce None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:41.905487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc149cd-9efb-41f0-8840-5d8866d67e22 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:41.935696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 174/345] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 15:59:41.935898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:41.937688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e89e8-97fc-491d-bd22-7bde76c2fc3a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.938219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e89e8-97fc-491d-bd22-7bde76c2fc3a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.938689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e89e8-97fc-491d-bd22-7bde76c2fc3a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.940518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 175/346] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:41.941456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e89e8-97fc-491d-bd22-7bde76c2fc3a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:41.957391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:41.959116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:41.959819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:41.960264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:41.973572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:41.983444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:41.984357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 15:59:41.985303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:41.985899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 172/347] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:41.986664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.066635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.077309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e89e8-97fc-491d-bd22-7bde76c2fc3a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.107963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd94774-42d6-440a-acdb-0ad892a3f4d6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.121116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.122325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.122983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.123326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.156314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.157250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.157579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.157805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.159037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.160557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557db7-33fe-4a28-856a-b3cbd057c77c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.163655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 173/348] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.165013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.165302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.165585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.184800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:42.186124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:42.208967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.210451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.258222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.299609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 174/349] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:42.300515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.305585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.319104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 176/350] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:42.320041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.434800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58914bbc-f4b1-468f-a7eb-d6dda561edf2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.441329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73830-c685-4897-8603-fbf21758518f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.475575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.476430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.476745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.477026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.477795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:42.478109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.479554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.491108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 175/351] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.492332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.503579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.504535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.504817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.505094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.514163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.515645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.517396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 177/352] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.518166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.556070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.605511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.633679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb98fe-ab3e-4671-94de-0df713be2c68 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.656287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e06db-11eb-4da3-a36d-5469ba1461cb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.672943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.674516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.675002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.675718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.677394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.678883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ffea-0170-4133-8e66-f37665afdd02 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.681133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 176/353] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.682505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dca8-25ab-4cfe-88f8-148bc2175903 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.682797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dca8-25ab-4cfe-88f8-148bc2175903 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.683077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dca8-25ab-4cfe-88f8-148bc2175903 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.684313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 177/354] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:42.685198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08dca8-25ab-4cfe-88f8-148bc2175903 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.712755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.713860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.714803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.715097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.729225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:42.739681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:42.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:42.741425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:42.742598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 178/355] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:42.742843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.834374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08dca8-25ab-4cfe-88f8-148bc2175903 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.843290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.875468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f50d-a69d-4758-a4a9-6bd19185da5a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:42.884401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434333-981f-488f-b266-749010b29666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.886015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434333-981f-488f-b266-749010b29666 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.886783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434333-981f-488f-b266-749010b29666 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.887261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434333-981f-488f-b266-749010b29666 None admin] PATH_INFO: `/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.888787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a434333-981f-488f-b266-749010b29666 None admin] RBAC: Authorizing `identity:get_user(user_id=55200e86dde345d09e1f5aa7bdd5c0d7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.890500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a434333-981f-488f-b266-749010b29666 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.892183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 178/356] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/users/55200e86dde345d09e1f5aa7bdd5c0d7 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.894637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:42.895311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434333-981f-488f-b266-749010b29666 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:42.914195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:42.915208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.915678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.915960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.916929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:42.917248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:42.918721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e838f2a-96f4-49e0-b770-e2e700e7c0c5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:42.925773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 179/357] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=440da6136d59483baa79a4c88adb52a0 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:42.927364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:42.927659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:42.927939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:42.950258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:42.951312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:43.027943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434333-981f-488f-b266-749010b29666 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.045984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 180/358] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:43.047490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.077689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.078748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.079547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.079547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.081535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.084029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3448bf4-c440-4f10-9acb-a7bc5644192e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.086493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 179/359] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:42 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:43.091453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046e23-0077-41fb-88c1-8424240b977b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.091453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046e23-0077-41fb-88c1-8424240b977b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.091453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046e23-0077-41fb-88c1-8424240b977b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.091453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 180/360] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:43.091453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12046e23-0077-41fb-88c1-8424240b977b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.149927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.187124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15467829-b4bb-4656-8eef-4ad402d57f00 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.202565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.215356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12046e23-0077-41fb-88c1-8424240b977b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.242977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.243674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.243963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.244244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.245124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:43.245433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.246845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.257129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 181/361] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:43.258039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.260044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.261032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.261456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.261878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.262828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] RBAC: Adding query filter params (role.id=403f6c908b7c4e4d806ee567232b1ba5, user.id=55200e86dde345d09e1f5aa7bdd5c0d7, scope.system=all) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:43.263189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.264962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.277763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 181/362] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/role_assignments?user.id=55200e86dde345d09e1f5aa7bdd5c0d7&scope.system=all&role.id=403f6c908b7c4e4d806ee567232b1ba5 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:43.278424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.395209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140ba7-faa2-4dc0-8e47-459938374fa3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.409183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889a27-1007-4de9-9f17-632f7d4fa669 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.411120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.448718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.452205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.452875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.453801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.465626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.466302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.466614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.466886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.467931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:43.468746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.470454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f290c-ac23-4f2b-8800-f6aa88593d83 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.474428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:43.483588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 182/363] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:43.483588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.483588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.483588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:43.484440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:43.485315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:43.486108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 182/364] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:43.489255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.517566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:43.519378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:43.543272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.631932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 183/365] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:43.633303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.646564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8bbeb-918d-40a1-8500-2237433a06cf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.703657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.704630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.705144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.705590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.774962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.786039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5ed1-8b6c-474f-bfb8-00f3ac14e0c0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:43.793582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.795127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.831209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:43.832050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:43.832401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:43.832749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:43.833865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:43.834175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:43.835580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:43.840201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:43.850541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 184/366] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:43.851419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.924246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 183/367] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:43.925861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:43.981211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239330e7-00c6-46f7-8eb2-5f2cfa109647 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.027330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.028158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.028442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.029985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.045069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:44.049385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71666440-773e-4f00-aa80-3e7555df090e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:44.054005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:44.054902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:44.055684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:44.058568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 185/368] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:44.059659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.086356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.091376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.092122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.092334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.092648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.106343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.186142 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.187559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.193724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1cd-1373-44fe-bc7c-1b7a02745b5d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.242231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.243265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.243847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.244163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.245501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.247439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.250330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 186/369] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.251202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.303871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 184/370] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:44.304988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.345595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.361548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.379116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254478c-edfb-4234-938b-fafda44c415b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.417048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.418124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.418605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.419066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.419164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a32837-3fac-447b-a9dd-21612947b8a5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.420147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:44.420777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.422533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.431925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 187/371] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.437386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.456505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.457465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.457765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.458497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.459795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.461290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.464487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 185/372] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.464487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.562437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22478bbe-3086-48bd-90eb-dbdfe03b53ef None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.579269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78b27-ec8d-4c15-9540-0f887f55ff44 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.581025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.603418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.604745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.605228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.605742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.607161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.609085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.611461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 188/373] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.612415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.621226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.621870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.622149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.622423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.642506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.699165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.700954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.736571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20727-416d-4b30-a53b-8faac6f4c87e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.774244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.775333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.775809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.776272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.777480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=1a9b2ea932954cd3b935743cc04547e4) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:44.777990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.779858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.788031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 189/374] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=440da6136d59483baa79a4c88adb52a0 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.789149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.816870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 186/375] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:44.825744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.828016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.889878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:44.914378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd3a8-3dde-443a-8923-0c1bb62ffecb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:44.954734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:44.956108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:44.956706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:44.957307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:44.959133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:44.960913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:44.962934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 190/376] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:44.970148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:44.977372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d4052-b662-4736-9341-1b0f7e7957cd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.016098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.016999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.017318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.017593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] PATH_INFO: `/v3/projects/d319fa168ab84848b7e88269fc1c486a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.018798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] RBAC: Authorizing `identity:get_project(project_id=d319fa168ab84848b7e88269fc1c486a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:45.020279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:45.022521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 187/377] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/projects/d319fa168ab84848b7e88269fc1c486a => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:45.028237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:45.088827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111ac6-5593-4324-afb3-0935c84d5ddc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.102885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:45.130324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.131380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.131924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.132530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.133575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=1a9b2ea932954cd3b935743cc04547e4) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:45.134089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:45.135274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276181bc-5a96-4f1e-bea8-86d605b84136 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.136024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:45.143045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 191/378] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:44 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:45.173659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.174606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.174883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.175205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] PATH_INFO: `/v3/groups/c9c5795cd2ec45659fff2e72e9744d32` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.180757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] RBAC: Authorizing `identity:get_group(group_id=c9c5795cd2ec45659fff2e72e9744d32)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:45.182222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac2f1c-4f92-4548-9e61-b5d327b7dfaa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:45.184187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 188/379] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:45 2022] GET /identity/v3/groups/c9c5795cd2ec45659fff2e72e9744d32 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:45.190311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:45.207269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:45.303988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758982e-cf87-4c67-ad94-2e06c425fe6e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.340288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.340903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.341187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.341564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.342422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] RBAC: Adding query filter params (group.id=c9c5795cd2ec45659fff2e72e9744d32, role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=d319fa168ab84848b7e88269fc1c486a) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:45.342738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:45.344225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec314e88-e767-468a-bfef-5317b2f829a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:45.351094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 192/380] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:45 2022] GET /identity/v3/role_assignments?group.id=c9c5795cd2ec45659fff2e72e9744d32&scope.project.id=d319fa168ab84848b7e88269fc1c486a&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:45.487882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647117f-6064-4be0-b0e9-7e1fdfc06777 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.488173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647117f-6064-4be0-b0e9-7e1fdfc06777 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.488492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647117f-6064-4be0-b0e9-7e1fdfc06777 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.490093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 189/381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:45.496201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.496536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.496794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.515262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:45.516514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:45.596543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 193/382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:45.624482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647117f-6064-4be0-b0e9-7e1fdfc06777 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:45.755663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647117f-6064-4be0-b0e9-7e1fdfc06777 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.794987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.796224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.796734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.797227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.800994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:45.812164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:45.820490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:45.821466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:45.822306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:45.828580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 190/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:45.831543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:45.840820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:45.959230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32043-c08c-49ba-8374-9377d9d931d8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:45.996788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:45.997478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:45.997830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:45.998107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:45.998877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:45.999250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:46.000675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:46.009702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 194/384] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:46.015738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:46.144983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0d36-901d-4e77-bc8e-1854a4cd3760 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:46.189332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:46.190603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.191104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.191605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.196540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:46.198283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299f263-e276-4a3e-873a-d66c40d240d7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:46.200602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 191/385] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:46 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:46.206545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:46.213126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4622-0f46-499a-b6d7-e5bbb592f36b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.213384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4622-0f46-499a-b6d7-e5bbb592f36b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.213666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4622-0f46-499a-b6d7-e5bbb592f36b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.215274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 192/386] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:46.220819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.221415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.221900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.253247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:46.256269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:46.317835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:46.364295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:46.368396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43288a-bda9-47e1-b4f3-1e481c7a0ccd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:46.388474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 193/387] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:46.413239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:46.433907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:46.434894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.435220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.440513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.440513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:46.440513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:46.440513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 195/388] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:46 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:46.449067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:46.564437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170522b6-7ca6-4ffd-a82c-14794f5ff471 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:46.636574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:46.637789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.638322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.638803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.651859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07513-23b5-44d1-bcdb-eb60b17b79dc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:46.658206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:46.671392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:46.672350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:46.673195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:46.686554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 194/389] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:46.691893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:46.733068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:46.734474 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.734954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.735435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/groups/38f0d02967cb42c19c94ea05902fa152/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.738930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, group_id=38f0d02967cb42c19c94ea05902fa152, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:46.741603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:46.750916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:46.775797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 196/390] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 5 15:59:46 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/groups/38f0d02967cb42c19c94ea05902fa152/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:46.790562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:46.849554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28726a30-ba23-41af-9842-1555bc227295 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:46.905715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:46.906423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:46.906731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:46.906978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:46.907745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:46.908054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:46.909522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:46.924966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 195/391] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:46.930725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.075416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908155-f3ce-4027-a79b-1b464019eecc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:47.111340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:47.112225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.116567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.116899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.118204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:47.119684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:47.121704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 197/392] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:46 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:47.127273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.282718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf74ca-7bb0-4161-bc33-eef02b9a03f6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:47.296884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:47.316950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:47.317832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.318114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.318390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.319579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:47.321078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca7c2a-152f-46c2-b00e-2b4e30f55087 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:47.323101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 196/393] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:47 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:47.329567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.400856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c0cb-2875-4cc9-9e65-b01a49f126c9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.401211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c0cb-2875-4cc9-9e65-b01a49f126c9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.401412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c0cb-2875-4cc9-9e65-b01a49f126c9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.403089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 197/394] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:47.408190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.408507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.408793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.424481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:47.445564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:47.446857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:47.474530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98a84-501c-49d3-9b9e-f4805411cdcb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:47.543585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:47.544969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.545464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.546103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/groups/38f0d02967cb42c19c94ea05902fa152/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.550785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2f2658222541f9b77ee48cffbcfecc, group_id=38f0d02967cb42c19c94ea05902fa152, role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:47.552657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3d39-e747-498f-a1e7-982a1303475a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:47.574879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 198/395] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:47.576260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 198/396] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 5 15:59:47 2022] PUT /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc/groups/38f0d02967cb42c19c94ea05902fa152/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:47.600195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.706022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c4d8-402a-43dd-a636-6dc79be13a1a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:47.720911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:47.742863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:47.744111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.744633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.745107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.757369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6c786144-09a7-4f61-b8b9-bdd79dcede45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:47.766110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:47.767086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:47.767861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:47.770750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 199/397] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:47.775454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7f73-6e4e-47f5-b374-41d0d1ebb2f4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.776146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7f73-6e4e-47f5-b374-41d0d1ebb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.776638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7f73-6e4e-47f5-b374-41d0d1ebb2f4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.778619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 199/398] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:47.784143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:47.784793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:47.785260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:47.785636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7f73-6e4e-47f5-b374-41d0d1ebb2f4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.805802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:47.807035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:47.889157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 200/399] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:47.919998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:47.963840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7f73-6e4e-47f5-b374-41d0d1ebb2f4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.015805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.034880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.035565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.035852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.036131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.036920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:48.037234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.038632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910e955-06d2-43a1-9c24-430c25cf5c72 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.052053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 200/400] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.053787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d183-7a54-41a3-bef7-0ec3e4d43f07 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.054286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d183-7a54-41a3-bef7-0ec3e4d43f07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.054773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d183-7a54-41a3-bef7-0ec3e4d43f07 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.060597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 201/401] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:48.062542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.063037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.063382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.080171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:48.081476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:48.084258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7670bf-b2be-4d5a-87d1-3ecb5d1deb45 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.086740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.129774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.132148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.132669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.133385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.147387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:48.152058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 202/402] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:48.153040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:48.156908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:48.157804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:48.158607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:48.161848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 201/403] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:48.171447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.278558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cda21-5a83-4750-997f-f9b968e2e82e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.286074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a905be0-cc13-46c5-80d3-abcb8ded9cb9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.296836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.316358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.317266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.317586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.317863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.319035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.320840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.323215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.323974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.324263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.324571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.325334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:48.325688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.327418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.327534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 203/404] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.328394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.336835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 202/405] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.337759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.363994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.428832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3fd69-ae04-4c90-9442-2217a11edf9c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.444122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990e53-5c12-41c9-a889-5f61a1b55b30 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.462894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.463725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.463994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.464272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.474555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:48.481585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.482722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.483220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:48.483605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:48.484543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:48.485755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 204/406] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:48.486668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.487550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.489068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.490983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.493283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 203/407] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.494232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.536604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.591092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0eee-859e-4dda-b677-9fe51eb5b922 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.598665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.609705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcd14-c3e7-46ab-80c3-bf53ca5cf804 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.624365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.625274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.625873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.625873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] PATH_INFO: `/v3/groups/c9c5795cd2ec45659fff2e72e9744d32` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.627009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] RBAC: Authorizing `identity:get_group(group_id=c9c5795cd2ec45659fff2e72e9744d32)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.628501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.630475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 205/408] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/groups/c9c5795cd2ec45659fff2e72e9744d32 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.631284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.648818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.649930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.650539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.651053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.651993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:48.652522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.654256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.663911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 204/409] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.665166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.730241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb768d-14ed-490d-a6c9-24d3742b17ff None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.742944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:48.764093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.764998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.765277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.765563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/groups/38f0d02967cb42c19c94ea05902fa152/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.767636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, group_id=38f0d02967cb42c19c94ea05902fa152, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.768991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.777337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47e345-c5d7-4ed0-b2db-9d8476f6b29b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:48.785428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 206/410] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 5 15:59:48 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/groups/38f0d02967cb42c19c94ea05902fa152/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:48.793751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.816098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:48.817417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:48.817900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:48.818368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] PATH_INFO: `/v3/projects/d319fa168ab84848b7e88269fc1c486a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:48.819975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] RBAC: Authorizing `identity:get_project(project_id=d319fa168ab84848b7e88269fc1c486a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:48.821661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:48.824166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 205/411] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/projects/d319fa168ab84848b7e88269fc1c486a => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:48.833885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:48.890788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:49.007000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62040026-672b-4387-ab4a-0d6f16da58b2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.025439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e226-2ff5-4aa0-a804-55ca80183815 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.048219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.049544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.049830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.050108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.051695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:49.053731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:49.055930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 207/412] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:48 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:49.062228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:49.070346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.071253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.071537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.071815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] PATH_INFO: `/v3/projects/d319fa168ab84848b7e88269fc1c486a/groups/c9c5795cd2ec45659fff2e72e9744d32/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.074335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d319fa168ab84848b7e88269fc1c486a, group_id=c9c5795cd2ec45659fff2e72e9744d32, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:49.075851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:49.094323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 206/413] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 5 15:59:48 2022] PUT /identity/v3/projects/d319fa168ab84848b7e88269fc1c486a/groups/c9c5795cd2ec45659fff2e72e9744d32/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:49.118464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:49.183154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff416-9dd7-4519-b912-96b07eeb84d0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.220982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.221864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.222141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.222423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.223697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:49.225177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793fb2-b146-4e2a-a95e-b71ece8b316d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:49.227238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 208/414] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:49 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:49.232973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:49.335470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:49.354381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc503d1c-0269-4820-b04e-e5b143a67cc2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.372511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f334c-ebd4-46da-a09c-b474574f1615 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.372819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f334c-ebd4-46da-a09c-b474574f1615 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.374132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f334c-ebd4-46da-a09c-b474574f1615 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.374996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 209/415] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 15:59:49.382695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.383124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.383498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.403419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.404651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.404967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:49.405255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.405686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4/groups/38f0d02967cb42c19c94ea05902fa152/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.406542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:49.411416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b2ea932954cd3b935743cc04547e4, group_id=38f0d02967cb42c19c94ea05902fa152, role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:49.412964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:49.439239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 207/416] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 5 15:59:49 2022] PUT /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4/groups/38f0d02967cb42c19c94ea05902fa152/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 15:59:49.503284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 210/417] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:49.538603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:49.670752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3483b-9a76-4afc-9740-3fa11542054c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.710263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.711097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.711450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.711726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.723330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:49.731374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:49.732340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:49.733210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 208/418] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:49.738586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:49.781651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:49.858999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5681-0e71-4776-8c15-97df5c812d2f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:49.903523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:49.904264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:49.904571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:49.904851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:49.905620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:49.905929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:49.907338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65a8e3-628b-4e7d-a31e-dbf312de6660 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:49.917201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 211/419] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:49.923122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:49.929543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:50.068615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf5e1-7314-4355-8ffb-64fa5a9a9fd3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:50.114516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:50.115180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.115457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.115730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.118530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055ad3c-273f-42af-9fb4-18567a421d7e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.119051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055ad3c-273f-42af-9fb4-18567a421d7e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.119203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055ad3c-273f-42af-9fb4-18567a421d7e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.121069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 212/420] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:50.129953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.130519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.131003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.163897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:50.165128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:50.247199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:50.250448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:50.254020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:50.310069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 213/421] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:50.357667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.401538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 209/422] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 15:59:50.401754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:50.407114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.506376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431c43-8a02-4576-bd5b-566b128b8299 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:50.520802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:50.558096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:50.559495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.561602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168c93-c67e-4b7c-be9b-6bc61e241818 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:50.562096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.562569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.565367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:50.567045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:50.574235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 210/423] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:50.575297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.638490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:50.639720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.640201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.640692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.660112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:50.668269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:50.669183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:50.670054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:50.685885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 214/424] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:50.691524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.810844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d2db-15a4-451a-af7b-86b5d2f179b6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:50.830909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:50.843941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b123e-cc8c-43a4-b33d-b9c72ba5963d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:50.879601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:50.880494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.880785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.881061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.886309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:50.889629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:50.894116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 211/425] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:50.901410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.911814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:50.912539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:50.912828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:50.913106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:50.913872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:50.914179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:50.915577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:50.929656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 215/426] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:50.937217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:50.973780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.085744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664c4-718c-4cd8-8f2a-65ef0fcfa491 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.109516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239627c3-37cd-4ed7-bf85-2076101790a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.147039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.147702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.147982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.148257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.149128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:51.149437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.150902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70960210-343e-4979-b924-bff30d10aac4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:51.164659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 212/427] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=440da6136d59483baa79a4c88adb52a0 => generated 611 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:51.190446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.191166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.191416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.191694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.236860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.265362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d787-e302-40dc-b9e8-7bb5adbe26c2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.265946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d787-e302-40dc-b9e8-7bb5adbe26c2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.265946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d787-e302-40dc-b9e8-7bb5adbe26c2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.267375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 213/428] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:51.273103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.273602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.273878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.312720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.314328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:51.314984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:51.316200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:51.429063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 214/429] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:51.455861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.463197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 216/430] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:51.469500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.497144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.543454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.577613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0322a0-3ba5-4691-b5c4-fbc0f69face4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.607785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ec9d-0744-473e-aa8d-0153c81636a6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.616925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.618187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.618672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.619140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.631312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:51.640051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:51.640976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 15:59:51.641768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:51.644352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 215/431] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:51.650296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.651462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.651820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.652041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.652582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] PATH_INFO: `/v3/projects/ce2f2658222541f9b77ee48cffbcfecc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.654110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2f2658222541f9b77ee48cffbcfecc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.655946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:51.662852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 217/432] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/projects/ce2f2658222541f9b77ee48cffbcfecc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:51.664140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.769354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.778899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d3c8-577a-4a08-b0a0-1068933f0c81 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.785099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bab4e-57e4-4c26-90e7-52b185dae2e4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.810163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:51.817299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.817986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.818463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.818940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.819798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:51.820243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.821799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03029d-67e7-4070-9823-fe79e753a4bf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:51.827832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.828741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.829030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.829305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.830490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.831432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 216/433] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:51.831934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270fad-e5a7-4347-ad61-0ef73cae4032 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:51.833158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a004-322d-4e8a-bedb-ef43f4d2a48f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.833598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a004-322d-4e8a-bedb-ef43f4d2a48f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.833894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a004-322d-4e8a-bedb-ef43f4d2a48f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.834269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 218/434] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:51.835217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 217/435] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:51.835466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b256-6cdb-4480-a6a5-19eb33b4df99 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.835748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b256-6cdb-4480-a6a5-19eb33b4df99 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.836024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b256-6cdb-4480-a6a5-19eb33b4df99 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.837511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 219/436] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:51.840148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b256-6cdb-4480-a6a5-19eb33b4df99 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.840567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.840856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.841255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.859232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:51.860436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:51.931089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 218/437] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:51.931975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:51.953337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b256-6cdb-4480-a6a5-19eb33b4df99 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:51.988672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:51.989343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:51.989633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:51.989922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:51.990757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=ce2f2658222541f9b77ee48cffbcfecc) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:51.991067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:51.992531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea245d-5102-4491-b972-e9cb72b5e307 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.004523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 220/438] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=ce2f2658222541f9b77ee48cffbcfecc&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:52.004523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.004523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.004523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.023557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.023765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:52.026049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:52.045957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8839d-ee62-460e-aeda-fe3ad3e55931 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.081677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.087068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.088049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.088334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.088642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.105759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 221/439] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:52.106639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.174779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.176097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.237389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6cfe-42cf-4115-8178-196399fc15dc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.269117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.276431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.277240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.277517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.277797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.289356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:52.289991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 219/440] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:52.290655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:52.299091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:52.300005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:52.300888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 222/441] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:52.301556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.356003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.404242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988509f4-ca07-4c23-904f-e2937f224436 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.412763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee264-98a8-483a-9878-db4f3ec0d4ad None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.436275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.437114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.437387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.437656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.445585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.446444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.446728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.447001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.447391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:52.448183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.449684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.451519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 223/442] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:52.452280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:52.455627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:52.456562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:52.457346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 220/443] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:52.458362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.507562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.556933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400c345-23f0-4f71-9ce7-882453da0d39 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.563004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688f8e-74b2-474b-80e1-b3f6613b0397 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.567232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.592823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.593494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.593904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.594182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.594935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:52.595242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.596745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.597035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.597906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.598183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.598455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.599634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.601090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.602864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 221/444] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:52.603443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.608959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 224/445] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:52.609775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.703277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569761-01d9-4a67-bdac-9f33a2a79757 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.708781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82e7d-ed5e-4e56-8c2a-9340fa6f37ca None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.716049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.737066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.737747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.738030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.738312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.739071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:52.739409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.740839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.741228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.741886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.742174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.742451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.743287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=440da6136d59483baa79a4c88adb52a0, scope.project.id=1a9b2ea932954cd3b935743cc04547e4) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:52.743600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.745082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:52.748790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 222/446] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:52.749567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.764533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 225/447] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=440da6136d59483baa79a4c88adb52a0 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:52.764533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:52.806749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.856917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4422b8-607a-485a-a065-02463e88c68f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.881494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749c122-b051-44c0-a4be-9ee6331d6390 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:52.896060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.896782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.897037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.897309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.925173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:52.925842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:52.926126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:52.927016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:52.945892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:52.978311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:52.979809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.007926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.009510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.051095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:53.101151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 223/448] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:53.107024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.129761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 226/449] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 15:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 15:59:53.135229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.176499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:53.201531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f54c-357e-4128-8ac1-3f1f947fcdf5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.232665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb710-e0b1-4615-8849-b328b1cfc3be None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.235480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.236351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.236681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.236957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] PATH_INFO: `/v3/projects/d319fa168ab84848b7e88269fc1c486a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.238155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] RBAC: Authorizing `identity:get_project(project_id=d319fa168ab84848b7e88269fc1c486a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.239626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.245732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 224/450] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/projects/d319fa168ab84848b7e88269fc1c486a => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:53.246725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.265883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.266757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.267041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.267318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] PATH_INFO: `/v3/projects/1a9b2ea932954cd3b935743cc04547e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.268547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] RBAC: Authorizing `identity:get_project(project_id=1a9b2ea932954cd3b935743cc04547e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.270106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.271721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 227/451] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/projects/1a9b2ea932954cd3b935743cc04547e4 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:53.276964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.280382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:53.348805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb82e-f1f8-4de8-9f4e-64dd2bb71c9d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.375545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32839b6-f7fe-4029-892d-c6ab005b3173 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.384807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.385675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.385948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.386238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] PATH_INFO: `/v3/groups/c9c5795cd2ec45659fff2e72e9744d32` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.387398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] RBAC: Authorizing `identity:get_group(group_id=c9c5795cd2ec45659fff2e72e9744d32)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.388936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.390551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 225/452] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/groups/c9c5795cd2ec45659fff2e72e9744d32 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:53.396240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.407821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:53.408311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.409235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.409544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.409826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] PATH_INFO: `/v3/groups/38f0d02967cb42c19c94ea05902fa152` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.411109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] RBAC: Authorizing `identity:get_group(group_id=38f0d02967cb42c19c94ea05902fa152)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.412619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.418908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 228/453] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/groups/38f0d02967cb42c19c94ea05902fa152 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:53.419887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:53.492578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:53.495773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c393fd-934f-406c-baaf-ce355f68f1bb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.523182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988775f-268c-498d-b146-e95167b622c9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:53.529654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.530311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.530588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.530860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.531695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] RBAC: Adding query filter params (group.id=c9c5795cd2ec45659fff2e72e9744d32, role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=d319fa168ab84848b7e88269fc1c486a) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:53.531995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.533456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4794831-b7f8-4ec8-aae5-64e21410ea29 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.539100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 226/454] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/role_assignments?group.id=c9c5795cd2ec45659fff2e72e9744d32&scope.project.id=d319fa168ab84848b7e88269fc1c486a&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:53.563133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:53.563820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:53.564104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:53.564382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:53.565275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] RBAC: Adding query filter params (group.id=38f0d02967cb42c19c94ea05902fa152, role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=1a9b2ea932954cd3b935743cc04547e4) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:53.565604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:53.567108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fd6fc-2ac3-426f-86b7-e896166a7969 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:53.574243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 229/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 5 15:59:53 2022] GET /identity/v3/role_assignments?group.id=38f0d02967cb42c19c94ea05902fa152&scope.project.id=1a9b2ea932954cd3b935743cc04547e4&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:56.149675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708fc87-64d6-43d1-bb07-16c973b2001d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.150211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708fc87-64d6-43d1-bb07-16c973b2001d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.150211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708fc87-64d6-43d1-bb07-16c973b2001d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.151839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 227/456] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:56.157251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72daa0-febe-45ac-93a8-a537fc2f3a57 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.157635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72daa0-febe-45ac-93a8-a537fc2f3a57 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.157812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72daa0-febe-45ac-93a8-a537fc2f3a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.181421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4e72daa0-febe-45ac-93a8-a537fc2f3a57 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:56.182636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4e72daa0-febe-45ac-93a8-a537fc2f3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:56.271081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 230/457] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 15:59:56.294895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708fc87-64d6-43d1-bb07-16c973b2001d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.391561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f648-d47b-47da-b42e-57402a34e532 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.391889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f648-d47b-47da-b42e-57402a34e532 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.392132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f648-d47b-47da-b42e-57402a34e532 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.394587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 231/458] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:56.403317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:56.403546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d17-942c-487b-a85e-e1ce97bbd163 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.403546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d17-942c-487b-a85e-e1ce97bbd163 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.403546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d17-942c-487b-a85e-e1ce97bbd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.422181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-38764d17-942c-487b-a85e-e1ce97bbd163 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:56.423367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-38764d17-942c-487b-a85e-e1ce97bbd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:56.453011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708fc87-64d6-43d1-bb07-16c973b2001d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:56.517759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:56.518576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.518851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.519123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.533993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:56.535670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:56.544861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:56.558989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 232/459] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:56.560495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707a1a0-2a45-4829-ba3e-72e21cf6a2a9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.560945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707a1a0-2a45-4829-ba3e-72e21cf6a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.561234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707a1a0-2a45-4829-ba3e-72e21cf6a2a9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.565541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 233/460] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:56.569628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.569920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.570200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:59:56.570300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:56.571086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:56.571927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:59:56.571927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:59:56.571927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.571927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:56.571927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 228/461] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:56.577006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.595671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:56.597714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:56.672557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 234/462] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:56.672557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.713939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0db40-bc20-413f-bbad-f3a8f9105ddb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:56.751741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:56.763778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:56.764771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.765346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.765808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.766822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:56.767319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:56.768955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971aaa9-19d8-4415-81c2-1736c54252ea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:56.769688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:56.788133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 229/463] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 15:59:56.789365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.795851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:56.804542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:56.805540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.805829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.806108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.817086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:56.818668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:59:56.837980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:56.838895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:56.839730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:59:56.839730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:59:56.839730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.839730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:56.844194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 235/464] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:56.845078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.902357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78806cd-b203-4692-898d-5b6af660a5dc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:56.944374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:56.945687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.946165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.946628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.947722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2c9a-e2a3-4460-9275-1e62e2a12c4a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:56.959588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:56.961495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:59:56.979925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:56.980924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:56.981884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:59:56.981884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:59:56.981884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:56.981884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:56.981884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 230/465] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:56.982594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:56.988577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:56.989270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:56.989555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:56.989834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:56.990545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:56.992032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba97c-f80c-4b1c-8bee-b4caa6c6c759 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.014632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 236/466] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:56 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:57.016024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edbab-3ba5-4f7e-a83e-33d1d472a3d7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.016313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edbab-3ba5-4f7e-a83e-33d1d472a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.016638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edbab-3ba5-4f7e-a83e-33d1d472a3d7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.022072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 237/467] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:57.022072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edbab-3ba5-4f7e-a83e-33d1d472a3d7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.042773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.065290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.138661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ade5a-3461-400f-b1d6-75a8d5a902db None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.159843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edbab-3ba5-4f7e-a83e-33d1d472a3d7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.183811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.184599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.184982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.185216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.185976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:57.186279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.187931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3282a52-2d62-466a-8e0f-fc5deeb031bb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.200515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 231/468] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:57.201859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.202144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.202454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.208355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.209130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.209415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.209694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.210432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:57.210739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.212114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.219777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:57.221006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:57.230838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 238/469] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:57.231732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.305422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 232/470] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:57.306622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.352997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.355675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.363894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bffd6e-2410-4b1b-a873-da3432b7d779 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.401693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.402380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.402666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.402942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.403696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.405479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.428591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 239/471] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:57.429528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.442070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76c7d1-19f1-4422-8631-052091fc3229 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.498409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.499720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.500254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.501213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.502443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.504490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b26c0-d219-4f8e-92d7-95f77856863d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.540951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 233/472] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 15:59:57.544081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9404-d8b1-4fb7-93a0-ad354c57545a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.546008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9404-d8b1-4fb7-93a0-ad354c57545a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.547056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9404-d8b1-4fb7-93a0-ad354c57545a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.554744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 234/473] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:57.557496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.560195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.560742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.589915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:57.591213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:57.608683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76bad1-4c92-4d74-90fa-864d8c44d809 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.655990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.656973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.657321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.657664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.671475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.673065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 15:59:57.694211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:57.695127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:57.695970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 15:59:57.695970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 15:59:57.695970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 15:59:57.695970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 15:59:57.695970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 240/474] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 15:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:57.700469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 235/475] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:57.701770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.705573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.720837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.740624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.826477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae865751-5a93-4637-882f-12ca4cf3ee25 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.852427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aa2cb-33f5-41ba-b24a-4febe1f343ed None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:57.865918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.866598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.866878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.867155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.867882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:57.868188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.869971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.882911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 241/476] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:57.888058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.891631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:57.892700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:57.893212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:57.893698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:57.894703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:57.896344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:57.905252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 15:59:57.905252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 15:59:57.905252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [parameters: {'id': 'ade2b22da7a14d49965c6f60dc574ff2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 15:59:57.905252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 05 15:59:57.924230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 15:59:57.925240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 15:59:57.926154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 15:59:57.927018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 15:59:57.928675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 15:59:57.930627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'id': 'ade2b22da7a14d49965c6f60dc574ff2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:57.932612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 15:59:57.935164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:57.939225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 236/477] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 15:59:57.945567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:57.953894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:57.998679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dd093-dc16-4c5b-94c8-79350c3bb964 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:58.036597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:58.037669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:58.037669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:58.037963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:58.038658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:58.040105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:58.042175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:58.066114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 242/478] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 15:59:57 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 15:59:58.071744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8b6a8-55ef-462b-942c-dc59e160caee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:58.122356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:58.123378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:58.123755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:58.124130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:58.136020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e406ac5d-58b8-4d1f-88cf-c0cb8fa052b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:58.144541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:58.145596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 15:59:58.146578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:58.151251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 237/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 15:59:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:58.154651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:58.277581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219a55-93e3-4005-8853-9effe2e6fcc4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:58.296111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:58.316250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:58.317093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:58.317378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:58.317653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:58.318409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:58.318715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:58.320128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7b61-b3ab-4de5-ba83-eafdcd482d05 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 15:59:58.329472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 243/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 15:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 15:59:59.418308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33d5b-e28e-417e-a99a-fc3dc9ea074d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:59.418865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33d5b-e28e-417e-a99a-fc3dc9ea074d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:59.418865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33d5b-e28e-417e-a99a-fc3dc9ea074d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:59.420704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 238/481] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 15:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 15:59:59.441242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:59.441758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:59.441758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:59.469372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 15:59:59.470619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 15:59:59.567047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 244/482] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 15:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 15:59:59.606479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac33d5b-e28e-417e-a99a-fc3dc9ea074d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:59.732177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac33d5b-e28e-417e-a99a-fc3dc9ea074d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:59.780939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:59.782140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:59.782608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:59.783091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:59.799642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:59.805551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 15:59:59.815266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 15:59:59.816213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 15:59:59.817022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 15:59:59.819715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 239/483] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 15:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 15:59:59.827890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 15:59:59.949811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3883ab-02e1-46e4-a494-b1eeea0d6f67 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 15:59:59.964883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 15:59:59.990251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 15:59:59.990851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 15:59:59.991133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 15:59:59.991406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 15:59:59.992217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 15:59:59.992550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 15:59:59.993990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:00.009173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 245/484] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 15:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:00.014688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.131256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cad51-6746-462b-8a82-c1eb0b8f7b49 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.173868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.174682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.174961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.175235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.189098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:00.190554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-65553b39-917a-4e7c-a7ad-0eb8a743152c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:00.215074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:00.216109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:00.216983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:00.216983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:00.216983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:00.216983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:00.216983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 240/485] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:00.222560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.261132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fedd0-b293-4372-a71f-6d805653e3ba None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.261484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fedd0-b293-4372-a71f-6d805653e3ba None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.261682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fedd0-b293-4372-a71f-6d805653e3ba None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.263117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 241/486] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:00.275398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb604e6-043d-46df-a5ec-56caca674c78 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.275680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb604e6-043d-46df-a5ec-56caca674c78 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.275955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb604e6-043d-46df-a5ec-56caca674c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.300539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bdb604e6-043d-46df-a5ec-56caca674c78 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:00.301969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bdb604e6-043d-46df-a5ec-56caca674c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:00.396828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:00.413790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506ce5-3002-48be-918f-512b492589ee None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.431824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 242/487] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 16:00:00.437776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f9f9-3697-43ca-9890-3253972cf53f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.438069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f9f9-3697-43ca-9890-3253972cf53f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.438352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f9f9-3697-43ca-9890-3253972cf53f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.440315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 243/488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:00.446202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.446486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.446765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.469591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.470270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.470556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.470835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.471213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:00.471567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:00.471874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:00.472434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:00.473292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:00.493316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 246/489] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:00.494341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.532527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:00.555291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 244/490] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:00.556393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.637432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715094-7acb-43a8-946d-eaed071605a7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.671704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.672556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.672837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.673264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.675848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0a304-4c42-46fe-aa40-6257806a58fc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.684349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:00.687170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:00.692008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:00.692934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:00.693719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 247/491] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:00.695032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.718889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.719796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.720149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.720536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.727718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:00.729259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-11d5ac72-8adc-4db7-a553-949678834e3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:00.744998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:00.745928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:00.746825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 245/492] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:00.748054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3019e-1ea3-4c90-94ad-061e8c437343 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.748054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3019e-1ea3-4c90-94ad-061e8c437343 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.748054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3019e-1ea3-4c90-94ad-061e8c437343 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.752501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 246/493] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:00.752501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3019e-1ea3-4c90-94ad-061e8c437343 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.800077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:00.810939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4ca4-d765-4c18-9271-615f6cbbeb8b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.846805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.847603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.847882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.848153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.852849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3019e-1ea3-4c90-94ad-061e8c437343 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.858680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:00.866446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:00.867346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 248/494] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:00.871828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:00.894891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:00.895589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.896115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.896400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.897586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:00.898155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:00.900192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da10a-7645-4bf8-b481-17db14827b33 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:00.910610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 247/495] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:00.911704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:00.912392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:00.912709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:00.928764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:00.929945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:00.954855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:00.972640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09bdfa-5199-423d-a9e7-d4f2b440b599 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:00.996575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 248/496] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:00.997456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.007760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.008429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.009036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.009316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.010302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:01.010615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.012076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238e9f-2bc0-495a-b6ce-0f86f762633f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.049219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 249/497] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:01.050582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a851-6960-4869-8fbc-e1adb5d36de8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.050808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a851-6960-4869-8fbc-e1adb5d36de8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.051120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2a851-6960-4869-8fbc-e1adb5d36de8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.052627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 250/498] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:01.053111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2a851-6960-4869-8fbc-e1adb5d36de8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.065952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.102221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fc223-1421-4e68-845f-e2238c176d0f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.136937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.137624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.137928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.138203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.138948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:01.139256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.140681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.148510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 249/499] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:01.149291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.159835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2a851-6960-4869-8fbc-e1adb5d36de8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.174356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.193913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.194715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.194995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.195270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.208170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.209712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:01.226878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:01.227803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:01.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:01.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:01.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:01.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 251/500] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:01.228972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.253501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02c3d7-70d8-4b4f-889c-189424c03a6d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.286310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.287123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.287400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.287694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.291041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.298861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-8853567b-4934-410d-99d5-21d13ddf2fb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:01.306559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:01.307634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:01.308486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 250/501] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:01.309281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.309281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.309422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.325904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:01.327130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:01.334317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd44ac-327e-4988-bb79-1c75741dfdfb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.369076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.369719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.370004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.370301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.389813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 251/502] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:01.390619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.414608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.436823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.438309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.496752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63345-accb-47e7-9485-e109c82ba859 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.500274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.529423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.530225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.530505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.530764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.540632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 252/503] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:01.540749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.541470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.542121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:01.560226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:01.561112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:01.561948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:01.561948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:01.561948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.561948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:01.561948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 252/504] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:01.562201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.626465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.651585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694284-e4e1-4809-a492-f2f1b5caeca6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.660925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f0dff-460a-4017-a62f-dc55395d4bac None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.684935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.685634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.685909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.686155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.686866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:01.687189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.688622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.694179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.694826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.695104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.695369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.696110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:01.696416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.697851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.699921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 253/505] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:01.700876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.705882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 253/506] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:01.706666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.730353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.804853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502778f-11b8-4be6-8901-c9c0a0242e26 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.806128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61300c0-dad0-4aa7-951e-19ee14338710 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.836158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.844098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.844279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:01.846608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.848715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:01.848806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.848900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:01.848984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.849061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:01.857958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.858246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:01.859463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.859729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:01.876593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:01.877562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:01.883293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:01.883293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:01.883293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.883293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:01.883497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:01.884236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:01.885161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:01.885161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:01.885161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:01.885161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:01.885360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 254/507] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:01.885423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 254/508] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:01.885485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.885555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:01.959229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:01.978889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9778e-202a-49ba-8c36-ce98abaef52c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:01.984390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8659d5f-f1ab-4b66-be55-4933ac435f57 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.011416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.012231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.012525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.012842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.017926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.018643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.018930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.019289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.020296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.020499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.020865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.021886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.022504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.034507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 255/509] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.035320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:02.036485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:02.037344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:02.038210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 255/510] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:02.038751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.080757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.136786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6955c04-51ce-4bae-855d-00551c39eba4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.137888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc50435-338e-4cb5-b914-b015385af549 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.170541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.170767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.171337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.171452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.171615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.171708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.171895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.171989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.172697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.173004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.173849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.174394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.182866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.184322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.186838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 256/511] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.187870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:02.205915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:02.206938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 256/512] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:02.208287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.298659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.301326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891036a-b1b1-47a8-bfe2-5c8bcf7fb0bf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.307182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dee1e8-ebe3-4beb-815f-32124295fea0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.335063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.335727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.336006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.336282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.337038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.337340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.338720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.339938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.340906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.341211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.341472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.348833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.349947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 257/513] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.350290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.351860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:02.365751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:02.366655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 257/514] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:02.367746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.413439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.454106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8c79b-0de3-4f2a-8598-79cbbfa97381 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.466410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfdd89-4050-42df-aacd-6399feb186e4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.489992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.490681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.490965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.491244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.492092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.492412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.493914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.499660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.500331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.500851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.500930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.501618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.503067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.525142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 258/515] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:00:02 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:02.525950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.532366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 258/516] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.533396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.556104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.651314 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fb4a-076e-47f3-80c4-e21a75d3175f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.651540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82f3cd-9d25-4ee8-abd6-ede2af142dd7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.653002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.693210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.693808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.694091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.694375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.695144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.695465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.695998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.696854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.696963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.697144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.698021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.706555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.708378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.708888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 259/517] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.709705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:02.723768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:02.724692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:02.725535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 259/518] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:02.726454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.808183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.819816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c9e98-78ca-457b-9c7c-5e7412e0fddb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.832511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da750c-b69f-4e45-b322-de3fc25b35be None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:02.855591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.856296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.856649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.856932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.857777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:02.858092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.859545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.870503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:02.871402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:02.871857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:02.872362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:02.876932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 260/519] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:02.877763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:02.903932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:02.943168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:02.944873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:02.984684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a696-ff5f-45a8-ba71-cbabc3760cae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.019176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.019989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.020272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.020582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.026485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.028020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.029959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:03.044610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:03.045697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 261/520] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:03.046600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.055353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 260/521] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:03.056203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.139642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.160997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f92729-2d55-49b2-97f7-d77703f4011e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.161628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf7907-1580-4820-b9da-7f3dc78df7b1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.198149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.198475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.198725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.198868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.199159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.200036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:03.200230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.200511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.200820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.201242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.202189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.227916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 262/522] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:03.227916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.251058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.274873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.276369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.332244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700c180-59fa-466f-b38a-10f64c90941c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.367910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.368675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.368958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.369237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.370082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:03.370490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.372127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.375005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 261/523] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:03.375847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.385650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.399424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 263/524] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:03.399424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.461209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.489733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803b8bf-350f-4f9b-8e3f-2cad9df37b7f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.506592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0fea-cf44-467c-b021-c3246830e50a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.525124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.525934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.526196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.526480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.537072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.538535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.542724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.543627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.544199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.544718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.546121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:03.547020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.548686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.554565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 264/525] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:03.555497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:03.556325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:03.557469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:03.557469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:03.557469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:03.557469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:03.558009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.561606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 262/526] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:03.562469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.650931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.694804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619dd6-3ca3-4afc-acf2-104590af9dfb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.709248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b649-1705-48a1-bb19-bc3c8550cd81 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.727562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.736162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.737165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.737647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.738750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.761366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.762105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.762385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.762731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.774712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.776335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:03.794930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:03.796012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 265/527] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:03.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.812352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.814208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.907056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a03142-f273-4c7e-a495-ef2898a3329e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:03.913525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 263/528] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:03.914521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:03.923080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.944661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:03.948579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:03.949331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:03.949618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:03.949955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:03.951597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:03.951913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:03.953353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:03.966875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 266/529] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:03.967819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.017099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d6a5a-4bb8-47b5-ad6f-9249654ad955 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.063334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.064013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.064297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.064787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.065547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.065859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.067273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.079775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 264/530] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.080736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.086990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca58e8-dd32-4513-adb4-da1e14ccdeda None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.129736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.130924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.131399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.131873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.143961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.145793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:04.163735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:04.164872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:04.165768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:04.165768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:04.165768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:04.165768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:04.167875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 267/531] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:04.169092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.196133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.197945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.212875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611633b6-8d74-49ac-8b1d-41a563ea01e6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.261957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.262851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.263138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.263412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.272629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.274623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.286326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78c1a0-f882-4167-bee1-8af7e4a11da3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:04.295484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:04.296316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.297193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:04.299638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 265/532] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:04.300679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.328680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.329507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.329793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.330075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.339877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.341409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:04.360020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:04.360938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:04.361767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 268/533] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:04.362673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.424068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07771cc-688c-4670-a5ff-353ef61fba08 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.454835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.471253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.471912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.472198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.472499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.473242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.473551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.474967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.479249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e562-3d59-4e64-b746-95cefdcddfa3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.492956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 266/534] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.494207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.514030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.526037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.527355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.527897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.528484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.529473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.529978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.531822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.544618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 269/535] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.545773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.613103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c509d6-1695-48f9-b42b-55996b1ea2db None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.649806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.650554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.650934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.651306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.652427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.652882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.653630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b7928-7731-468d-bedb-5f1eb6eb8a4c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.654641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.674077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 267/536] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.674973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.692514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.693325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.693610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.693887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.700982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.702455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-98269f43-aab9-4506-97b0-1112279bada2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:04.717923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:04.719016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:04.720068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 270/537] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fc79-44f9-4cfc-94fc-c439caf3abea None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fc79-44f9-4cfc-94fc-c439caf3abea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707fc79-44f9-4cfc-94fc-c439caf3abea None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 271/538] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:04.725999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707fc79-44f9-4cfc-94fc-c439caf3abea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.737425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.757492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:04.791630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eb93-1a66-4701-8666-3c72158693e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.827032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.827876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.828303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.828732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.829667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=05b1165a25eb4467af1500b2c6199e1b) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.830078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.831941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.832087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707fc79-44f9-4cfc-94fc-c439caf3abea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.848478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 268/539] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/role_assignments?user.id=05b1165a25eb4467af1500b2c6199e1b&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.848478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:04.883313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:04.884283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.884663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.885084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.886134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=e7854f2cdbc443eab856854d0a1c8bef) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:04.886551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:04.888288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d47dcc-d5a7-4aa6-9f76-bd082fe41e6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:04.895571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 272/540] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/role_assignments?user.id=e7854f2cdbc443eab856854d0a1c8bef&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:04.897060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:04.897414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:04.897763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:04.916938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:04.918345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:04.990110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c049737-e3c8-449f-ae6f-ce9d8c6dc9ac None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:04.999130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:05.005307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 273/541] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:05.034814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.046555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.047643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.048105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.048582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.049653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:05.050181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:05.053934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:05.056831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:05.085926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 269/542] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:05.095870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.197568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54c8a1-af7a-4844-b12a-e5f6fdd51fae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.222248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7793c-e281-4a1c-9ed7-9ad632c65e53 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.266903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.267883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.268336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.268746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.291514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:05.300441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:05.301522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:05.302484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:05.308479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.308479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.308479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.308479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.308858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=e55aa833284d4f73932873f884f1bb18) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:05.308858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:05.308858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:05.313484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 274/543] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:05.321551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.322545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 270/544] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/role_assignments?user.id=e55aa833284d4f73932873f884f1bb18&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:05.394731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:05.457948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300b506-b8ad-42c7-b006-89c434725643 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.507677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.508794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.509279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.509751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.510781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:05.511293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:05.513015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee804c2-a4bd-4cde-9b72-4286b9a7f1b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:05.526267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 275/545] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:05.532134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.605464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:05.632289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc3a5-d594-4f97-99df-6c447333a155 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.632648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc3a5-d594-4f97-99df-6c447333a155 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.632865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc3a5-d594-4f97-99df-6c447333a155 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.634455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 276/546] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:05.639891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.640475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.640955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.656470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cf71-a2a2-4040-89da-2913b3ff4c91 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.677598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:05.678930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:05.694394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.695226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.695501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.695777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:05.720232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:05.721737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:05.754133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:05.755047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:05.756323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:05.756323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:05.756323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:05.756323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:05.756323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 271/547] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:05.762036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.811916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 277/548] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 16:00:05.835748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:05.909359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:05.943281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5675c-c729-4d83-bccf-80d7cb8640ce None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.984287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aa9c5-fb90-4299-8522-97997b815064 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:05.987907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:05.988913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:05.989334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:05.989749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.010638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:06.020868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:06.023843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:06.024767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:06.026110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:06.026919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.026919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.026919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.026919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.027175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:06.027175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.028439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.029697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 278/549] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:06.035641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.047993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 272/550] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:06.053393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.152229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f27a-cfec-4c2f-af92-7bd1d07c9bd0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.167310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.200985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.201923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.202427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.202839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.203739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:06.204202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.205764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.224048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 279/551] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:06.229600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.254136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c63a1-6661-4db6-bede-623098b957a6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.302372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.303254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.303537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.303897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.315799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.317300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:06.348811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:06.349842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:06.350832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:06.351847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 273/552] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:06.357235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.421681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.431919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b72c9-fb94-4020-b0b2-331dbdcd7879 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.503995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.504836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.505118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.505394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.526248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.527716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.550834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e7b8-ecfd-4fd0-8219-a987e8e2e4fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:06.561140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:06.563184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:06.564301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:06.564301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:06.564301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:06.564301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:06.564301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 280/553] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:06.570219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.615235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.616060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.616347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.616652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.617503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:06.617820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.619269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.626889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.640130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 274/554] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:06.645753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.740263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.753500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d36c9-cb24-446f-b249-71788d3852fc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.757274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36ded-c3e8-4b47-ae67-87656995ed6d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.789543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.790368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.790721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.791074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.824928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:06.825946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:06.826413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:06.826864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:06.827869 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:06.828476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.830070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.852147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 281/555] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:06.857622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:06.864308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:06.866126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:06.954659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.958930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:06.974297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e1a7b-6d32-421d-9b4c-7466bd722817 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:06.974577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 275/556] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 16:00:06.980068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.012397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.013537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.014000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.014449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.022301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.024119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:07.046289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:07.047742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:07.048683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:07.061011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 282/557] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:07.062133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.087949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3309-9ae1-47db-8bea-2f6f043a49c9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.162672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.163497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.163779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.164058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.183938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.186132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-81a66177-766d-42a4-9eb7-da49f079166b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:07.222553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:07.223510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:07.224493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:07.224493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:07.224493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:07.224493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:07.229012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 276/558] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:07.230393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f846-5ef9-42c6-8797-3c21659cd2e8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.230681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f846-5ef9-42c6-8797-3c21659cd2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.230960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f846-5ef9-42c6-8797-3c21659cd2e8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.231442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bebfe2-0d73-45eb-ac63-3ec9d7f6eace None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.236186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 277/559] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:07.238161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.238447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.238726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.266691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:07.268712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:07.274699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.275500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.275888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.276233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.277221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:07.277600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.279427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.297919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 283/560] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:07.298690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.303126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.316892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.360851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 278/561] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 16:00:07.361899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.425870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c983-10cc-4329-9b5f-fd21c8d8ba64 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.477136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.477974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.478356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.481633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.481633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:07.481633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.484207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.496636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1049-e8aa-4ae7-ac75-fbde49ce5126 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.497547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 284/562] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:07.498402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.534964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.535789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.536115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.536510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.546688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.548170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.564743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6861eaf8-6480-46f9-9199-982df7fcad17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:07.566938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:07.567927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:07.569064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:07.569064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:07.569064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:07.569064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:07.569064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 279/563] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:07.569594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6e78-023f-415f-918a-a4acaaf2aead None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.569881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6e78-023f-415f-918a-a4acaaf2aead None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.570161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6e78-023f-415f-918a-a4acaaf2aead None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.571405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 280/564] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:07.572091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6e78-023f-415f-918a-a4acaaf2aead None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.598281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.615032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a54c9f-e0fa-419d-b954-85158363fc59 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.653749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.654715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.655039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.655470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.666649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:07.674661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:07.675652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:07.676646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 285/565] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:07.677346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.691325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6e78-023f-415f-918a-a4acaaf2aead None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.727691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.728651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.728932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.729206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.736640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.738266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b6076250-0efc-4150-86a5-26cfe9440ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:07.752167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:07.753674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 281/566] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:07.754577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36601-8b5f-48fe-b3a4-3c82dafdf451 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.755133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36601-8b5f-48fe-b3a4-3c82dafdf451 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.755133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36601-8b5f-48fe-b3a4-3c82dafdf451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.771461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7ed36601-8b5f-48fe-b3a4-3c82dafdf451 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:07.772672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ed36601-8b5f-48fe-b3a4-3c82dafdf451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:07.780320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be176387-eb5c-4761-9a8e-5fddd874ec62 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.803212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.813763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.814442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.814729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.815007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.815737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:07.816047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.817466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.829179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 286/567] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:07.830090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.838174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 282/568] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:07.839501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c3db-bc40-46e7-9783-d2eba456fd82 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.839794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c3db-bc40-46e7-9783-d2eba456fd82 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.840112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c3db-bc40-46e7-9783-d2eba456fd82 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.841500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 283/569] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:07.842187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c3db-bc40-46e7-9783-d2eba456fd82 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.857268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:07.939204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485a9f-1e12-4236-8099-bf0451d92285 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.942524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c3db-bc40-46e7-9783-d2eba456fd82 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:07.975950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.976187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:07.976748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.976903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.976994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.977085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.977299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.977433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:07.978063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:07.978197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:07.978378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.978513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:07.979773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.979927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd5ae7-14f5-492f-b9c7-48c2cb526d35 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:07.988268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 287/570] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:07.989202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:07.991451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 284/571] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:07.992672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:07.992988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:07.993234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.009180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:08.010361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:08.041253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.076916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 285/572] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:08.077701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.080211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.098706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7d09-7739-45d5-998e-382404d77740 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.132478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.133279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.133559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.133855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.140746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.142226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:08.156237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:08.157257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 288/573] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:08.158275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.183642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38cd15-3a5f-4a05-ac0f-7d7d2ce8cb49 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.216287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.217130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.217452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.217734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.227747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:08.235536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:08.236711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 286/574] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:08.237651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.261516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed530d-bfbf-42cc-b8b5-92d1d1a54a76 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.269019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.296292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.297120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.297400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.297669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.298132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.307613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.309100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:08.326348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:08.327478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:08.328525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:08.328525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:08.328525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:08.328525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:08.328525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 289/575] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:08.328868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.341199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3eea-bd38-4cb9-96e7-d8d61ae3419c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.375935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.376706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.376991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.377268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.378100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=f0eaf162fd3647a0963e00de33419559) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:08.378412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.379853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.385806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 287/576] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/role_assignments?user.id=f0eaf162fd3647a0963e00de33419559&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:08.386590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.443323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2594a6-a309-4eab-94ee-ad93abd365ac None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.482215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.483458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.483458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.483646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.495287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:08.503435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:08.504578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:08.505603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:08.509811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 290/577] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:08.510791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.519943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef886fca-25c2-4c22-b98b-4b16606cd3d1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.534483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.548994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.568483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.568483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.568483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.568483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.568941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:08.568941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.568941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.576090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 288/578] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:08.576998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.627419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048ce3-bd18-4c00-9c8e-ff03263538fc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.661364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.662040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.662351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.662632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.663387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:08.663699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.665136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.673535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 291/579] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:08.676926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56e7bd-942d-46e9-b6ca-e00e05fc6ddb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.678561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.712509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.713338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.713728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.714105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.714927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:08.715333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.716893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.733015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 289/580] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:08.733015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.763810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.782319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:08.784060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55d41-2057-473d-ba16-6b3af8e8f605 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.818328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.819015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.819298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.819573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.820323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:08.820666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.822075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.832510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 292/581] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:08.832510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.844337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd022-d885-455a-96a1-997c60175dd7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:08.878194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:08.879022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:08.879302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:08.879576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:08.894480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=9bb2c2c6299946e1a172eb6948b28094, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:08.895935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:08.910834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 290/582] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:08 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:08.912097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:08.953338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98f72-c86b-484f-adea-bfb0e76e4d95 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.004068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.005604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.006743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.007441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.024296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.025840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.027850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.031029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.035033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051e080-2f5c-4706-9367-c7c6819c6fdc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:09.057801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.058798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.059788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:09.059788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:09.059788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.059788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:09.067179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 293/583] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.067179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.086701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.087527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.087796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.088071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.097635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.099105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:09.116414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.117455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:09.118487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:09.120852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 291/584] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.121973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.195158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407ee2d-cae8-4c9c-86b5-1d649285e47a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.231739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1d22-ae8d-48f2-8c1f-d7d58dd56fb9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.237717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.238537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.238819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.239094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.252537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.254009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.274735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.275421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.275704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.275982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.276741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:09.277049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.278521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:09.278782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.279607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.280532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:09.280532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:09.280532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.280532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:09.282813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 294/585] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.283902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.295290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 292/586] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:09.296139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.320264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.349039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.411371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9992-108b-4a9d-a495-34fa96d3ff31 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.415269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63243-08dc-4935-bacb-4f49a9b7e59d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.449557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.450558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.451102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.451390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.452482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:09.452819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.454868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.459358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.460143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.460548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.460918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.461746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:09.462144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.464230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.474606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 295/587] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:09.475546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.485725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 293/588] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:09.487144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.590146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.610757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a394d-0a48-48f2-be9e-dc6e3d6774a2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.614819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.622675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c393a3-7d08-4b8b-b5ce-5bc276219e9b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.655723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.656740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.657381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.657666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.667028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.668279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.669249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.669534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.669790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.669892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.680990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.682455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:09.686584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.687492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:09.688436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:09.695550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 296/589] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.696652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:09.701282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.702225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 294/590] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.703116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.799786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc754-83d0-4e18-8657-8900349f0238 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.804272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5316-fccf-4e87-a624-402dce0a653b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:09.833049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.836160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.837223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.837662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.838092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.843921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:09.844880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:09.845353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:09.845818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:09.847157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:09.847274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.847766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:09.848733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.849623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:09.865741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:09.866698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:09.867622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:09.875159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 295/592] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:09.875159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.875371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 297/592] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:09.876632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:09.913602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:09.997642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3134a3-3c93-4387-a7f6-38c0fe606487 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.003814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1e2fe-274c-4848-b6c0-f0f55341772b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.040145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.040850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.041088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.041203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.041407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.042133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.042440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.042702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.043173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.043667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.043865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.044909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.045484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.047208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.056977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.057993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.075741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 298/594] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 5 16:00:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.077755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.118974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.181710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fad6-5c75-40fd-80ff-2ead8d2356cc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.182407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.206731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071b517-b26f-4a47-b5d4-4f1fe872ca4e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.221742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.222872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.223348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.223912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.235440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.237206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.247962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.248724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.249016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.249294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.256348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:10.256792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:10.257616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:10.258498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:10.258498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:10.258498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:10.258498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:10.258713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.265286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 297/595] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:10.266398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:10.272874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:10.273750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:10.274629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 299/596] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:10.275673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.374258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.378649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffde85-25eb-4acc-bf78-833ad6703482 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.397806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff5c8-40e8-4e6d-8618-72b459ce05ec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.420491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.421316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.421757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.422046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.432379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.433073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.433356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.433631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.434386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.434692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.435768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.436070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.437793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.447963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 300/597] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.448823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.451664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e84e1b25-d47f-40c2-a96b-5762e4917c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:10.462051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:10.463231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:10.464325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:10.464325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:10.464325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:10.464325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:10.467834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 298/598] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:10.474370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe174-3621-4523-b399-708e2fc8f2e8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.474658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe174-3621-4523-b399-708e2fc8f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.474939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe174-3621-4523-b399-708e2fc8f2e8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.476282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 299/599] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:10.477033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe174-3621-4523-b399-708e2fc8f2e8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.563474 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd64033-1984-486f-95ab-9a2220df53e6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.598246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.598971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.599262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.599540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.600339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.600438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe174-3621-4523-b399-708e2fc8f2e8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.600770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.602116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.614697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 301/600] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.615514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.640555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.641368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.641653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.641944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.648804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.650267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-77b93a1d-6362-48f1-860c-6cfadf01a56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:10.666594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:10.667507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:10.668371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:10.672652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 300/601] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:10.673881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.674175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.674543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.677949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.692287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:10.693526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:10.698295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.719748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ce6b-a22a-4527-8a5f-fb11a4ce77e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.756105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.756965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.757339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.757713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.758511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.758815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.760196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.765415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 301/602] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:10.766439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.783607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 302/603] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.784765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.876827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa50a7c-f18d-4569-a431-95f183914bee None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.891782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a25fa-1ec4-42d5-894c-35d56cb69230 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:10.913666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.914569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.914844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.915112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/05b1165a25eb4467af1500b2c6199e1b/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.916284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.926690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:10.929840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:10.930611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:10.930715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=05b1165a25eb4467af1500b2c6199e1b, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.930899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:10.931174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:10.931970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:10.932236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.932343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:10.933745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:10.947256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 303/604] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:10.948062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:10.953484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 302/605] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:10 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/05b1165a25eb4467af1500b2c6199e1b/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:10.961426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.072524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b612d-90b9-4a48-b73e-eb8fe8deff52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.085323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0d32-1f7c-4e4f-b1c8-d2f93c7b30d5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.110808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.112680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.112680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.112680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.123665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.125244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.128734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.129494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.129776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.130083 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:11.139542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:11.140619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:11.141551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 304/606] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:11.142033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.146416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4b9147c7-e258-487f-8fc1-e3c997014c39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:11.154296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:11.155212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:11.156033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 303/607] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:11.157647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776f92-e0a0-4c3a-98f6-e8c3129c5bd1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.157647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776f92-e0a0-4c3a-98f6-e8c3129c5bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.157647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776f92-e0a0-4c3a-98f6-e8c3129c5bd1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.158678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 304/608] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:11.159226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1776f92-e0a0-4c3a-98f6-e8c3129c5bd1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.197064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.215823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.257379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2ff42-047d-4344-ba72-2b85584c5cc4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.269987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1776f92-e0a0-4c3a-98f6-e8c3129c5bd1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.294577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.295576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.295920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.296249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/e7854f2cdbc443eab856854d0a1c8bef/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.305554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.306317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.306662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.306998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.307854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:11.308228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.309837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.311753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=e7854f2cdbc443eab856854d0a1c8bef, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.313298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f348-f983-4c2a-bc4c-ef5b46564f95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.323031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 305/609] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:11.323747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.334106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 305/610] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:11 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/e7854f2cdbc443eab856854d0a1c8bef/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:11.346028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.346360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.346596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.372108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:11.373027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:11.455359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 306/611] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:11.458474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fb7d0-4927-4fde-9487-4caf5500f23b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.462084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.472765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.503543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.504325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.504933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.505126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.506420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:11.506803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.508574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.509553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.524654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 306/612] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:11.525759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.615246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106c0f-49ed-4e00-85e7-1fe36892d61e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.629993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03dee3-cd5e-4f36-840c-53311217126a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.664407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.665345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.665597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.665721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.665887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/e55aa833284d4f73932873f884f1bb18/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.666785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.667203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.667621 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.678857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:11.683185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=e55aa833284d4f73932873f884f1bb18, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.684745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:11.687855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:11.688977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:11.690108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:11.692090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 307/613] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:11.693029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.712591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 307/614] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:11 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/e55aa833284d4f73932873f884f1bb18/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:11.712591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.756735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.789464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:11.828647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af854-d51b-4b80-9d99-7e165afa5e5b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.864635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.865336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.865618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.865891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.867962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:11.868272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.869737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:11.887672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 308/615] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:11.891688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874309-a1d8-4cc4-9f2d-b7fbb81262e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:11.893650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:11.953500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:11.955386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:11.955386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:11.955386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:11.972330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:11.973768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:12.002413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:12.003387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:12.005229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:12.005229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:12.005229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.005229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:12.005229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 308/616] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:12.009938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.045716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3e57-9b42-4d1c-bd61-d36580a15ee3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.086861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.088046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.092186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.093641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.096774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.114780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.119425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:12.154189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:12.155206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:12.156092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:12.156092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:12.156092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.156092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:12.161712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 309/617] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:12.167099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.182951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.206026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c176ca-f2cb-40be-b26f-6c3978d66d1f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.251065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.251754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.252043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.252326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.253091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:12.254000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.255541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.268618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 309/618] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:12.274280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.348738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd127fc-cf2f-436b-8954-bb2868f729fa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.404794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26517-892e-4750-a1d8-411e6a3d53f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.413479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.414227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.414513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.414788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.415524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:12.415834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.417314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.439070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 310/619] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:12.440499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.441335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.441613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.441891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.443948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.449981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.451549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:12.467031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:12.468139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:12.469126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 310/620] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:12.481354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.492818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.534826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.649235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fb71c-0645-431b-9ba0-3139ff33a30c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.672032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8d97-71d4-4e89-9c87-819213933e8c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.716354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.717254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.717536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.717818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.728259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.730007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.737810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.738494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.738774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.739051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.739903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:12.740205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.741662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:12.745923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:12.746922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:12.747847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 311/621] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:12.754121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.766236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 311/622] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:12.775904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:12.841468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.882144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7584-4f90-4e1e-a576-bd41aa024eae None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.937534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:12.939197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:12.939679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:12.940153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:12.958138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:12.960653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:12.963931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdefa42-f6fb-47eb-8cb2-16fef39ab5e6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:12.978353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:12.988899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:12.989831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:12.990783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:12.990783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:12.990783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:12.990783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:12.990783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 312/623] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:13.001880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.032434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.033520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.034052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.034531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.035592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:13.036112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.037811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.073146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 312/624] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:13.078328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.109783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0177cf-e7ff-4114-9437-2767a2e73cd8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.125288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.146179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.146855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.147134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.147405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.148127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:13.148430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.149825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06805f4-0c04-48e3-b77d-8db0319f621c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.162939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 313/625] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:13.164305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880a7b-c5df-423a-b44b-37c014244c46 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.164617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880a7b-c5df-423a-b44b-37c014244c46 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.164893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880a7b-c5df-423a-b44b-37c014244c46 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.166439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 314/626] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:13.167927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a880a7b-c5df-423a-b44b-37c014244c46 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.194714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483067-7181-4005-b1c4-a0d699c7faf6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.234237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.235222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.235723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.236174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.271980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.281578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a880a7b-c5df-423a-b44b-37c014244c46 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.315264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.316480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.317252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.317480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.317900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.318260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.325642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.327202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-81e37cb1-8b7e-468d-ba80-93309cb29bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:13.342189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:13.343340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:13.344567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:13.346304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 315/627] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:13.347807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.348215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.349059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.370048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:13.371296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:13.398420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.433148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 313/628] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 16:00:13.434374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.439974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 316/629] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:13.441075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.503102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.545276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616fe4-24bd-49e0-9386-70fecb1d52e5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.545515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e86b8-e1ac-4ae5-8240-569a1076ffc0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.581550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.582223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.582875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.583157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.583326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.583945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:13.584257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.584368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.584765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.585124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.585759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.596684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.598006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 314/630] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:13.598460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.598697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fb84533d-7fdf-4d6e-bf98-05dd7276e2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:13.618660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:13.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:13.620983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:13.620983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:13.620983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:13.620983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:13.624607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 317/631] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:13.624607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7588d-e942-4eb8-bcb1-e79c27c7e0b9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.624607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7588d-e942-4eb8-bcb1-e79c27c7e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.624607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7588d-e942-4eb8-bcb1-e79c27c7e0b9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.625434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 318/632] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:13.626404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7588d-e942-4eb8-bcb1-e79c27c7e0b9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.645945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.708918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25e5c-07d0-4e60-b9f9-02353b6d19b5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.734323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.747174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.747994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.748279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.748590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.757735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7588d-e942-4eb8-bcb1-e79c27c7e0b9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.759831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:13.767605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:13.768585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:13.769518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 315/633] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:13.770280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.801205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.802109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.802410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.802683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/f0eaf162fd3647a0963e00de33419559/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.819973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=f0eaf162fd3647a0963e00de33419559, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.822196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36879-3368-4a74-910b-3f6e09a23057 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.838244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 319/634] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:13 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/f0eaf162fd3647a0963e00de33419559/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:13.845145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.845145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.845145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.861107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:13.862441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:13.892257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbda61-109b-4db0-9be8-22220f4d730c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:13.938268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:13.938851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:13.939387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:13.940328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:13.940328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:13.940778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:13.941090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:13.942526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:13.950371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 320/635] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:13.951931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:13.957122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 316/636] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:13.969469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.027241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.067928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd61c3-9c16-4d51-9d2c-aa6ef21cb068 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.088505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781d497-3219-41e4-a1b1-11e0566f868a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.105021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.105794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.106190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.106793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.107368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:14.107674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.109251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.118431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 321/637] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:14.119427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.127918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.128861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.129156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.129420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.136976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.138615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:14.153484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:14.154410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:14.155315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 317/638] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:14.156256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.185060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.229505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3715e7-cd59-4d84-bcaa-8730c74a5a96 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.265259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.266210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.266557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.266897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.267483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bc8c-8c90-47ed-af07-8e2428fad9b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.270236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.278714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:14.286423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:14.287542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:14.288530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 322/639] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:14.289858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.307766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.308687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.309251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.309642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.320665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.322262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-202c35d7-2317-46d5-99f2-5bc1c5c67b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:14.343458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:14.344690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:14.345779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:14.345779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:14.345779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:14.345779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:14.348821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 318/640] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:14.350922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb99ba-c656-4d9f-8933-e57228f8e6cd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.351192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb99ba-c656-4d9f-8933-e57228f8e6cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.351471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb99ba-c656-4d9f-8933-e57228f8e6cd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.352969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 319/641] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:14.353502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb99ba-c656-4d9f-8933-e57228f8e6cd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.405846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07d43-8c82-481b-a322-761bfe0ab6f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.423153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.440587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.441258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.441545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.441822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.442612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:14.442923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.444372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.457986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 323/642] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:14.458812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.467910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb99ba-c656-4d9f-8933-e57228f8e6cd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.509511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.510191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.510589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.510871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.511741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:14.512044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.513508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998266e2-f6cd-4d42-946f-757527390f02 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.526842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 320/643] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:14.526842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.526842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.526842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.544019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:14.545336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:14.559879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.572499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206e345-f4ae-4ba6-a604-ac6e5b651a7c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.606451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.607139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.607423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.607703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.608520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:14.608805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.610189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.624475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 321/644] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:14.624475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.624746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 324/645] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:14.627320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.667516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.740635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c090-becb-4cff-8691-f084e68a6ba7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.741507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1b5f-f111-4721-867c-6a44dbe17c68 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.774798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.775625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.775879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.776155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.777247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.777927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.778175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.778444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.779268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:14.779576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.781045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.787039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 322/646] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:14.787546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.787820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.789644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.812567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:14.815939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:14.817211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:14.818434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:14.818434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:14.818434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:14.818434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:14.820853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 325/647] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:14.821990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:14.920583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22487-037f-48b7-969d-80c4a02de8bc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.925624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:14.936756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcc141-d059-410c-9181-7c86d7e3a43b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:14.972568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.973865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.974151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.974432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.975140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:14.975959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:14.976239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:14.976556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:14.985166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:14.986946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:14.988693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:14.997445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:14.998402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:14.999226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 326/648] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:14.999910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:15.006958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:15.007906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:15.008925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 323/649] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:15.009527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.096245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.130285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf33ea-a60f-43f2-99ee-a7f978cf4e28 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.136056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e56-ca37-4231-a41a-f354f9bea41e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.165420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.166106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.166372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.166648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.167404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:15.167924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.169140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.177744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:15.182705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.184749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.185416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.185717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.186150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.186887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:15.187193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.189549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.205520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 327/651] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:15.206367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.221943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.315038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e384-313a-4488-afc7-7c064a6da994 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.328897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2d35-92c1-4bfb-b71d-ccedb0afba36 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.351229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.351992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.352335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.352714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.353642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:15.354222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.355531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.357422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.370278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.372309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.372865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.373322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.374547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 325/652] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:15.375596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.385965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.387947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:15.409286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:15.410239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:15.411129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:15.411129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:15.411129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:15.411129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:15.418151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 328/653] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:15.419312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.476923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bdd16-4908-4e3f-86cb-64facc921f56 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.491207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.514550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.515452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.515842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.516184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.523888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.525502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.537778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3234fdd-1646-4c56-a49e-9bfd2fc54caa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:15.540326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:15.541290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:15.542232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 326/654] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:15.542843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.579630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.580672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.581140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.581614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.597693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.647276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b274a-10d5-499b-aad0-53e552ce1228 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.662924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.665024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.682787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.683459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.683738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.684043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.684797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:15.685100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.686472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.702388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 327/655] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:15.702388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.740849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.789479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 329/656] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:15.790705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.802870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ef90-822f-41c7-9a99-1659c1a2fbdd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.816295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:15.838538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.839375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.839759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.840298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.841207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:15.841613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.843135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.861649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 328/657] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:15.862664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.905369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78318-c01f-4f27-9c3d-754bfdbcbdf2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.942827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.943932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.944392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.944839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:15.953221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:15.955165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:15.961945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cb64-c2b7-4ac1-92a1-1c52ecadf161 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:15.970548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:15.971503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 16:00:15.972439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:15.976376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 330/658] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:15.977158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:15.995635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:15.996572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:15.996894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:15.997167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.001786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.009280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.010730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-32fdbf58-0f62-46fa-b385-bff1b1a11963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:16.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:16.031043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:16.031939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:16.031939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:16.031939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:16.031939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:16.035967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 329/659] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:16.037348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81444b4-12c9-46b1-91bd-bc9de1b08703 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.037643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81444b4-12c9-46b1-91bd-bc9de1b08703 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.037926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81444b4-12c9-46b1-91bd-bc9de1b08703 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.039344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 330/660] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:16.039951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81444b4-12c9-46b1-91bd-bc9de1b08703 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.066323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.087594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6318f-6af4-4c56-9c6d-def3d4c456a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.127747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.128404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.128712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.129084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.151228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81444b4-12c9-46b1-91bd-bc9de1b08703 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.185486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.186242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.186525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.186974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.188438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:16.188818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.191248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.198756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.200714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b82e-9941-436b-8a69-f17a9b661ce9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.214533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 331/661] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:16.214533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.229824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.294782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.309137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 331/662] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:16.310713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.311068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.311415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.321691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc7e42-7967-498c-92c2-6637ff5dd383 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.327801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:16.329036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:16.359983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.360711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.360970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.361254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.361981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:16.362289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.363675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.375456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 332/663] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:16.376261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.399917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 332/664] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:16.401099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.468576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.502717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11fb2-43db-4baa-abc4-0db75e44eef4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.523742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b421b3b-f8e3-4e9a-9cdb-5f877cc506ea None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.539756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.540547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.540827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.541189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.554265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.559634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.560482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.560775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.561054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.571204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.572693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:16.591150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:16.592193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 333/665] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:16.593204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.619285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.620803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.698982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225208a-7352-4a52-82e8-12cf57b4fb10 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.701916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.723645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 333/666] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:16.728930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.736539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.737348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.737634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.737916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.744857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.746326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:16.760737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:16.761660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:16.762593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 334/667] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:16.763093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.776293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:16.837402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18f6a-740b-4e25-9e50-69baa1cb7756 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.871708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.872902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.873154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55f925-71f1-4508-86e7-74a01e92abef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:16.873617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.874091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.884985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:16.893084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:16.894179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:16.895114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:16.897435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 334/668] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:16.898371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.912464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:16.913183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:16.913444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:16.913726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:16.914466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:16.914777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:16.916173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:16.929192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 335/669] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:16.929992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:16.958027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.008132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.011332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e861-9811-4c90-98a9-290441726c40 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.032520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a9bd-54fc-444d-8a3d-e8ab3b55a426 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.044022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.044863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.045154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.045432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.055954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.057495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.064904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.065567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.065851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.066123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.066915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.067223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.068673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:17.074511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:17.075582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:17.076506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:17.076506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:17.076506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:17.076506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:17.076506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 335/670] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:17.076800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.089016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 336/671] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.089016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.168889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.180711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4228-c83a-4da0-af5a-c4674f8e8647 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.183629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f598-1b58-4171-83c3-56a65d2b63fb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.215519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.216335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.216651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.216929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.217020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.217676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.217775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.217990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.218089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.218380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.219401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6a00-5b81-4d7a-a8bd-1d7f1a449d4b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.227378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.228925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.229903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 336/672] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.231179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78327-a7f9-43ff-bad8-d9aa6ea35342 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.231466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78327-a7f9-43ff-bad8-d9aa6ea35342 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.231746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc78327-a7f9-43ff-bad8-d9aa6ea35342 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.232993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 337/673] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:17.233687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc78327-a7f9-43ff-bad8-d9aa6ea35342 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:17.248859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:17.249981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:17.250930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:17.251361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.251431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 337/674] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:17.251886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.338782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc78327-a7f9-43ff-bad8-d9aa6ea35342 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.351464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f0c5-d3fb-48e2-9266-a963f1295803 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.372311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.372999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.373276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.373547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.374260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.374561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.375927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.384399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.385089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.385372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.385649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.386480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=05b1165a25eb4467af1500b2c6199e1b) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.386791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.387513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 338/675] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.388319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.388534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d32f-ec44-44d4-871f-a27f24577f5d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.400519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 338/676] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/role_assignments?user.id=05b1165a25eb4467af1500b2c6199e1b&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.400519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.400519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.400519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.416764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:17.418004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:17.420610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.494520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.503091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 339/677] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:17.504939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.519813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa9bc-2ff1-4cee-bc14-46e7c60e338a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.559647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.560784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.561075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.561348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.573346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.574858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:17.592814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:17.593725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:17.594596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:17.594596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:17.594596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:17.594596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:17.595113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 339/678] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:17.595848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.631907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28364e9-b4a8-4bf4-9a79-fbe78ba68b46 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.665805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.666481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.666763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.667044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.667832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.668143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.669694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.676372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.687190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 340/679] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.688252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.702277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901de92-33d4-4550-bff6-dfa02e59c0bb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.734128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.743415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.744225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.744528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.744807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.751825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.753315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:17.767584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:17.768562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:17.769459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:17.773356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 340/680] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:17.774495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.796716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9068-a230-4e35-b64d-95c8cebb6344 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.834407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.835221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.835510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.835787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.847715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:17.855458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:17.856528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:17.857375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:17.861651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 341/681] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:17.862490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.890682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0102-48cd-4b55-89ee-9dd097a7b42f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.922530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:17.926630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:17.927391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:17.927676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:17.928036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:17.928793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:17.929105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:17.930573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:17.947739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 341/682] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:17.947739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:17.973282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e672c-c453-4cc8-bbf7-6fd2a4d14b4f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:17.996083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.009820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.010498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.010781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.011058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.011894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=e7854f2cdbc443eab856854d0a1c8bef) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.012269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.013850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.019810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 342/683] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/role_assignments?user.id=e7854f2cdbc443eab856854d0a1c8bef&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.020405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.079906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711a1d-4da2-429e-b181-e6093b3c982c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.129409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.129925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.130212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.130552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.131368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.131732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.133286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.145375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a33b4-7d3c-4025-adae-3288e61f4fbc None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.147587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 342/684] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.148603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.173412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.187278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.188611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.188902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.189182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.190033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.190251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.191678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.207301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 343/685] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.211547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.289989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282088-62dc-4a1f-b271-3f7d74e2a25a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.299362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.327877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.328802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.329153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.329495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.338359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.339954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.348166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e97189-e0bc-4971-b59b-ab2c965a8a4d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:18.356295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:18.357326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:18.358278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:18.358831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 343/686] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:18.359673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.388897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.389557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.389841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.390182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.391016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=e55aa833284d4f73932873f884f1bb18) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.391376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.392900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.404651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 344/687] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/role_assignments?user.id=e55aa833284d4f73932873f884f1bb18&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.405630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.479557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932c032-3cfa-4045-b4eb-9defc13f202c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.519853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.522336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.522636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.522917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.530038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.548492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.550009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:18.585186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:18.586169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:18.587070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:18.587070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:18.587070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:18.587070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:18.593224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 344/688] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:18.595470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.635696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.641452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ef0e-f34b-425d-8627-81d9ff837619 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.683239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.684200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.684660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.685109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.686098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.686555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.688370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.709219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 345/689] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.715023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.723539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998e35d-2f98-4d55-a4f6-a15e3243d19e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.762275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.762818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.763106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.763384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.764129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:18.764436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.765871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.780615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 345/690] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:18.786281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:18.844701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b1ddf-e331-41fd-888a-6621dc2ded0f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.854746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.885751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:18.894306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.895022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.895573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.895869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.916814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87377c4-43a4-41b0-9e2f-f02bc3e052a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:18.953836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:18.954611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:18.954896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:18.955178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:18.963916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:18.965813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:18.982203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:18.983191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:18.984225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 346/691] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:18.990958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.040040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.042837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.184407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e1b8e-811c-46e6-bc3e-b180e69a4e63 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:19.219725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:19.220344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.220660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.220939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.221792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:19.222105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.223935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.234650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.247980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 347/692] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:19.253145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 346/693] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 16:00:19.253768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.259183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.267816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.362440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0140a4e-68f3-4b3a-8a45-4653571a7bc5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:19.385885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1097-9506-4979-986b-e8796dc51313 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:19.415104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:19.415776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.416058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.416338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.469175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:19.470067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.470296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.470578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.488419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.488870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.492934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.493630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.495117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d969b3-d66d-43f8-8c40-894e40b735b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:19.525202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:19.526223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:19.527126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:19.527126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:19.527126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:19.527126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:19.527126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 347/694] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:19.533286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.645710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.668838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 348/695] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 16:00:19.670207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41c8b-9cc3-443f-ae05-83abdc418313 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.670501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41c8b-9cc3-443f-ae05-83abdc418313 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.670996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41c8b-9cc3-443f-ae05-83abdc418313 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.672630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 349/696] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:19.674987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41c8b-9cc3-443f-ae05-83abdc418313 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.697191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f575dd-6f04-4d9a-9955-ff5adbaf9089 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:19.732469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:19.733091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.733372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.733649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.734379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:19.734683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.736068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf307-304f-4359-9c71-7379d3c1cc77 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.748533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 348/697] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:19.749883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.750172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.750450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.768975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:19.770158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:19.808167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41c8b-9cc3-443f-ae05-83abdc418313 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:19.820810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.844579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 349/698] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:19.845572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.860508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:19.861328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:19.861609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:19.861882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:19.876987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:19.879119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:19.902799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:19.903788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:19.904761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:19.904761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:19.904761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:19.904761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:19.904992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 350/699] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:19.911099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:19.913472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:19.986222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20fcdb-4cb6-469f-bcbd-2fb85ae25e55 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.033833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.034877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.035552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.035836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.038111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f21e07-f4b6-4a39-a2e9-155d26d64b8f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.044535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.046511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:20.065193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:20.066646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:20.067760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:20.071561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 350/700] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:20.072570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.079314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.080302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.080682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.081067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.094318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.095882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.104938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:20.115300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:20.117012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 351/701] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:20.119247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.199555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf3a2-7e2e-428b-9a47-e53c4624fc62 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.211492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.235553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19880d16-c41e-4875-adac-def8d46c47ce None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.237942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.239288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.239288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.239288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.239920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:20.240229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.241702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.254507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 351/702] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:20.255445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.279831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.281099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.281762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.282216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.283311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:20.284071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.286094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.306713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 352/703] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:20.306713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.368576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac316a-9490-4e59-8a0f-28c149667deb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.371714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.405148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.405859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.406144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.406418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.407150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:20.407465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.408917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.413325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d98ee-3b3f-46c7-9abc-cc3e38e5256c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.424544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 352/704] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:20.424544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.451935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.453475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.454522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.454879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.455203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.462839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.464300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-83680993-7259-48ff-aeba-81cde33d4743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:20.481726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:20.482667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:20.483554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:20.485729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 353/705] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:20.486903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e891f0-d7e2-42bc-9fa4-9045f322f130 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.487185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e891f0-d7e2-42bc-9fa4-9045f322f130 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.487466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e891f0-d7e2-42bc-9fa4-9045f322f130 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.492680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 354/706] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:20.492680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e891f0-d7e2-42bc-9fa4-9045f322f130 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.537475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b343a-d281-461e-9ecd-69d82c587bc7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.574390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.575406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.575702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.575983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.577153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=f0eaf162fd3647a0963e00de33419559) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:20.577615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.579061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.596486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 353/707] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/role_assignments?user.id=f0eaf162fd3647a0963e00de33419559&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:20.596486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.614447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e891f0-d7e2-42bc-9fa4-9045f322f130 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.649304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.670148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.671027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.671373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.671715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.672525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.674321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fead-574c-4738-b2b0-2cccc431145d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.709135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 355/708] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:00:20 2022] POST /identity/v3/users => generated 254 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:20.711000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.711359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.711753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.719809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:20.735607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ab5dc-737a-4bc9-ac20-336d6e57c708 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:20.747150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:20.750079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:20.796973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:20.797932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:20.798357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:20.799017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:20.800106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:20.801576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:20.803263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:20.823658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 354/709] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:20.831098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.850254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 356/710] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:20.877738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:20.962984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa5541-c9ae-4e41-bdff-c5f7e9c2eb99 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.006133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40120-57ee-4fff-b36c-5f24a744f73b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.011330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.012390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.012922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.013454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.014562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:21.015088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.015791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:21.018023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa295f-7fbc-4a11-8575-6f27da64eae8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.026297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 355/711] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:21.028362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c2a92-1112-4616-990e-6eb4f432ac7e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.033016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c2a92-1112-4616-990e-6eb4f432ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.033188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c2a92-1112-4616-990e-6eb4f432ac7e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.034905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 356/712] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:21.041448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.041754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.042017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.049621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.050473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.050759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.051041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.052330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.053378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.063587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:21.064874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:21.069394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:21.070409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:21.071351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 357/713] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 5 16:00:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:21.077079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:21.083390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:21.202709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 357/714] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 16:00:21.213046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f58b-15a0-48fe-a387-9415f7c5a306 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.245774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:21.263031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.263635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.263920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.264198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.264959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:21.265269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.266685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.271849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 358/715] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:21.277468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:21.313225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:21.391663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06d3b-8103-46a0-9b99-86c132f77acb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.405823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ccae1-d50a-48c6-a47e-3dfd1533f1ef None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.452152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.453002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.453287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.453693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.454421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.455984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:21.471424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:21.472506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:21.473680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 358/716] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:21 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:21.479052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.479913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.480297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.480806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.482031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:21.483622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:21.485956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.487397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.502831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 359/717] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:21.503540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:21.629103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85355dec-ffc4-4948-a6b1-813f82bd9dc6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.691345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.692497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.692995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.693466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.694432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:21.694950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.696688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72935ce6-a92c-47ae-82e2-f07535a131b4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.708582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 359/718] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:21.714604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:21.828935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:21.835256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb3ba2-f0ef-40a2-8622-c3542cbc290d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:21.877911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:21.878594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:21.878878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:21.879223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:21.879886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:21.880195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:21.881626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdd861-86fc-4d0b-b7d9-c6ded106b4d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:21.886727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 360/719] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:23.046604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7004ca-b514-4c20-9855-bdb4ff202f7a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.047174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7004ca-b514-4c20-9855-bdb4ff202f7a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.047174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7004ca-b514-4c20-9855-bdb4ff202f7a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.048835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 360/720] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:23.054086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4efb23-7e84-4b18-9527-b1c2b5cae149 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.054911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4efb23-7e84-4b18-9527-b1c2b5cae149 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.055411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4efb23-7e84-4b18-9527-b1c2b5cae149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.077221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d4efb23-7e84-4b18-9527-b1c2b5cae149 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:23.079631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d4efb23-7e84-4b18-9527-b1c2b5cae149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:23.170181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 361/721] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:23.210094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7004ca-b514-4c20-9855-bdb4ff202f7a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.243127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cfb1-ff17-404f-bc2c-107498ebc29f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.243469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cfb1-ff17-404f-bc2c-107498ebc29f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.243983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1cfb1-ff17-404f-bc2c-107498ebc29f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.246208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 362/722] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:23.250720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.251247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.251747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.281123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:23.282663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:23.352941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:23.402222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7004ca-b514-4c20-9855-bdb4ff202f7a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:23.419782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 363/723] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 16:00:23.443368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.467584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:23.468406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.468718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.468989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.471103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:23.497367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:23.513218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:23.514267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:23.515124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 361/724] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:23.520599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.555753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02db8c-d204-4255-8baf-a6813bd851ca None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:23.620809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:23.622091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.622746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.624413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.644817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:23.653854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:23.654832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:23.655775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:23.658563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 364/725] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:23.665775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.703147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c984-01a3-47d6-95d5-71e825e1babf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:23.737285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:23.738292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.738292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.738585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.739271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:23.739583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:23.741032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be2779-3f8e-4834-9bf6-94cb96c17277 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:23.749958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 362/726] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:23.750243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:23.755148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a429ce-d00b-4d3b-a629-2a87c32c89e8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.755449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a429ce-d00b-4d3b-a629-2a87c32c89e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.755737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a429ce-d00b-4d3b-a629-2a87c32c89e8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.757294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:23.758216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 363/727] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:23.759935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a429ce-d00b-4d3b-a629-2a87c32c89e8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.779926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4031-551a-44e6-a299-7ce17f974b86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:23.816976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:23.817865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.818222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.818567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.819396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:23.819705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:23.821303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2f151-694f-4f24-8d45-1abeb1405452 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:23.835314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 365/728] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:23.835314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.835314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.835314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.852123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:23.853451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:23.895296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a429ce-d00b-4d3b-a629-2a87c32c89e8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:23.930244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:23.931148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:23.931492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:23.931830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:23.935783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 366/729] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:23.936868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:23.952354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:23.953881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:23.980907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:23.982007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:23.982906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:23.982906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:23.982906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:23.982906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:23.987081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 364/730] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:23.991679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.019717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.041976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.047294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64410-7ae0-49d0-ae12-eb2e460e74d3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.083877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.085447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.085918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.086363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.095307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffdc7-dd95-442e-b1c6-4d440f19d50d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.098485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.100112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:24.118623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:24.119772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:24.120848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:24.120848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:24.120848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:24.120848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:24.122820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 367/731] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:24.128082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.131816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.132597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.132952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.133893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.134086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:24.134458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.135904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.153554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 365/732] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:24.155020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.237336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf28a6-39b9-418b-95aa-bfa3463e23f3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.261403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0016-b22c-4202-b966-4fdfead643c3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.265260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.271048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.274429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.275264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.275585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.275825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.286248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:24.293885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:24.294818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:24.295659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 368/733] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:24.296332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.300710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.301380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.301662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.301940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.302667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:24.302974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.304357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8b63e-8b3a-4904-a680-a396d6416814 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.315794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 366/734] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:24.317105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e297-44a3-47d2-acb1-47c3424c2feb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.317394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e297-44a3-47d2-acb1-47c3424c2feb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.317671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e297-44a3-47d2-acb1-47c3424c2feb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.320776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 367/735] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:24.320776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e1ec-bb97-44df-b2ef-351584818727 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.320776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e1ec-bb97-44df-b2ef-351584818727 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.320776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e1ec-bb97-44df-b2ef-351584818727 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.324486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 368/736] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:24.324486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e1ec-bb97-44df-b2ef-351584818727 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.403109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c9a0-f962-4e58-a489-7d91c0695642 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.422716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e1ec-bb97-44df-b2ef-351584818727 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.437037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.437843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.438127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.438404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.446305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.447789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.455192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.455861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.456147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.456426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.457207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:24.457884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.459251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d67636-523a-4577-897e-b5c46539d96a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:24.462288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:24.463372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 369/737] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:24.469348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.474217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 369/738] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:24.475951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006d91-8cdb-40cc-915a-bf0d54e1f2a1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.476686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006d91-8cdb-40cc-915a-bf0d54e1f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.477047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006d91-8cdb-40cc-915a-bf0d54e1f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.494152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-98006d91-8cdb-40cc-915a-bf0d54e1f2a1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:24.495354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-98006d91-8cdb-40cc-915a-bf0d54e1f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:24.510926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.518619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.561593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 370/739] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:24.572685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.572685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.572685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.572969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb75de-378e-4800-ac2c-324ad8659e2b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.580979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:24.582921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:24.601448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.602269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.602548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.602816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.610517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.611981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:24.626299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:24.627413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:24.628583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 370/740] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:24.629321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.653813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 371/741] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 16:00:24.654837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.737527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f43a1-1444-4fae-ac6b-cf37804820ad None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.744591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.748495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.759479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1f707-b1ad-4cf8-b225-6b05266946c4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.775116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.775803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.776084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.776366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.777245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:24.777621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.779070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.792261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.793135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.793418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.793696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.796161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 371/742] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:24.796970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.804690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.806099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:24.823355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:24.824405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:24.825377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:24.825377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:24.825377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:24.825377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:24.825377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 372/743] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:24.825657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.900375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6369b9-09e1-4300-888f-92eb80a33331 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.921969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08720-524d-4217-806d-9a92d057734b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:24.933540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.934237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.934520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.934800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.935518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.936951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.952030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 372/744] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:24 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:24.952976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:24.971020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:24.971728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:24.972003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:24.972277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:24.973166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:24.973473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:24.975060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:24.983494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:24.984697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.000734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 373/745] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:25.000734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.076500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e97ed-647a-4b2a-bae3-ef8a8036c42c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.109355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef1cb0-6086-4e53-950a-02983c6037f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.118970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.120014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.120301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.120626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.121759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.123319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.140718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 373/746] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:24 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:25.141991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.154909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.155593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.155872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.156150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.238731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.251452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.253225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.376069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.398748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240742a-5754-46b5-aa47-04be3e3231d2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.400297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 374/747] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:25.401462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.440344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.441393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.441868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.442319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.443257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:25.443745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.445331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.458217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 374/748] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:25.459280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.538729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.549948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1c0b-e739-41e6-9705-8acbe117f793 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.569388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5419d0-d5ae-4e25-ba8b-9d27d3812f6c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.590274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.591291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.591797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.592275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.614896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.616094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.616962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.617446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.628389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.630172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:25.648170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:25.649320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:25.650221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:25.650221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:25.650221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:25.650221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:25.652518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 375/749] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:25.652716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.653830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.678253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.679966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.756341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77636758-ec39-4bc5-b6da-208824c3d467 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.792683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.793308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.793888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.793888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.794079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.803967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 375/750] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:25.804815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.808390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.810042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:25.825583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:25.826525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:25.827462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 376/751] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:25.828059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.888692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:25.923618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304a54-d89d-473d-a2b0-36069e77e300 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.944378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f82b-04d3-4855-adf8-986640080531 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:25.960118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.961028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.961523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.961991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:25.962906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:25.963352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:25.965023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:25.982247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 376/752] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:25.982247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:25.986956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:25.987775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:25.988055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:25.988330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.001741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.003790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:26.025733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:26.026797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:26.027941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:26.027941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:26.027941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:26.027941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:26.034121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 377/753] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:26.035120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.042071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.094672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2735-c729-459c-ada4-07cb4d1c08ab None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.127839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.128704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.129078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.129450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.130386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.130799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.132348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.140990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baca021-6752-43b7-8629-19c7b8c09c6b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.151837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.156923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 377/754] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.157996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.180731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.181838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.182264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.182680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.190684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.193413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:26.210417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:26.211360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:26.212258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:26.219655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 378/755] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:26.221515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.263738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a7f3-c467-4390-9e66-e5d20d1eeb11 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.280998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.298581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.299257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.299536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.299811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.300563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.300869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.302268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.318993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 378/756] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.318993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.336164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98e16-6b04-4f58-9d66-9032b602824b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.372141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.373322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.373808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.374321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.386206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.388024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:26.405935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:26.406816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:26.407705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:26.407705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:26.407705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:26.407705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:26.410030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 379/757] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:26.411108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.422155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026d465-8222-4c63-9ace-0e69d3a6ecbb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.441509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.459994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.460686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.460965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.461237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.462015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.462318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.463742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.484323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 379/758] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.484323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.510111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.540875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58e8b-842b-493e-a157-31b201590478 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.576259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.576934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.577218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.577499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.583403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8ae7-e54f-497f-8f36-33c1fd9fbf25 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.585111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.586763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:26.602113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:26.603027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:26.603931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:26.608116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 380/759] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:26.609107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.622538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.623492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.623965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.624490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.625417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.625913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.627495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.644235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 380/760] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.645447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.694194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.715344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47740c-8cc2-40ca-bf15-d743655da5d4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.738361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:26.749362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e76a-ddca-4d22-87d8-1634cf49a40f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.751085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.752326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.752677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.753677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.754051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=f0eaf162fd3647a0963e00de33419559) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.754369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.755882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.767411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 381/761] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/role_assignments?user.id=f0eaf162fd3647a0963e00de33419559&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.768427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.786968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:26.788065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:26.788603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:26.789074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:26.790098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:26.790620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:26.792330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:26.805911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 381/762] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:26.814058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:26.986794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0939be-305b-420f-914b-0e0a594303ea None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:26.993408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bda7d-7c82-4499-97ca-abd95d3abed4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.026719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.027343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.027631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.027912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.028818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=cfc40069aff94b77a542e3c02eea4c79) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:27.029136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.030613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.040493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 382/763] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/role_assignments?user.id=cfc40069aff94b77a542e3c02eea4c79&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:27.044211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.045087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.045428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.045707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.053888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.055466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f4b86d35-2c7b-494f-819d-856cdcd428f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:27.071087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:27.072047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.073259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 382/764] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:27.081779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.100215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9902-4f9d-4106-9e65-ebd7e2939fec None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.100591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9902-4f9d-4106-9e65-ebd7e2939fec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.100805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9902-4f9d-4106-9e65-ebd7e2939fec None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.102526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 383/765] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:27.109937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.110449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.110975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.113687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.119437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.133790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:27.135381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:27.215930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 384/766] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:27.259672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.269963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bed5b-25e8-414d-8dfa-ae648343a343 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.312139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.312975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.313252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.313523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.314407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:27.314715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.316192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95615f-516c-4130-a903-e3b095c4daf2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.331891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 383/767] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:27.337725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89eabd-1ef6-4c79-9d78-9007e3d7cec9 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.338012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89eabd-1ef6-4c79-9d78-9007e3d7cec9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.338292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89eabd-1ef6-4c79-9d78-9007e3d7cec9 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.339733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 384/768] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:27.341159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89eabd-1ef6-4c79-9d78-9007e3d7cec9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.388967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba210-8c78-498f-b50b-4d2e0038aedc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.421963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.427287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.428365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.428887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.429419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.430270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.431874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.434054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-675cac26-d8d5-4274-a4fe-d6f0f26cd5e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:27.446468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:27.447461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:27.448346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.454998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 385/769] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:27.454998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.454998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.454998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.456874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89eabd-1ef6-4c79-9d78-9007e3d7cec9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.475014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:27.476622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:27.497688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.498384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.498664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.498938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.500986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=9bb2c2c6299946e1a172eb6948b28094, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.502462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.524562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 385/770] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:27 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:27.524562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.595157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 386/771] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:27.635969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.703447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54bae-c22d-4d40-9c0f-052789bfeb8f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.750859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.751541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.751824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.752100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.753213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:27.753213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.754530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.755747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.760906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 386/772] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:27.766609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.780315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61000-199e-4a84-bab8-ae6a00d01c36 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.808827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:27.817651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.818891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.819364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.819828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] PATH_INFO: `/v3/services/network` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.820704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.822284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:27.835438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:27.836443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:27.837317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:27.840226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 387/773] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:27.846325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:27.907115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b0f5-691d-4ec0-aaf8-39e436a5f324 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.951728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04b2-f119-4d3e-b62a-e2dd85f82a00 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:27.986826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.987861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.988334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.988877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.989155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:27.989854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:27.990140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:27.990420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:27.990680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:27.991143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:27.991359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.991455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:27.992922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.993282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:27.998670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 388/774] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:28.003918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 387/775] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:28.004636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:28.009111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:28.073563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:28.109931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce2e7-9a3d-4eff-b5ac-83893571975f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:28.124845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:28.180958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:28.181640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:28.181981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:28.182257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:28.183014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:28.183325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:28.184777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:28.190908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c1a60-4f6b-4f9c-b890-4923d3e33bb4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:28.202648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 389/776] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:28.208970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:28.278756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:28.279446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:28.279727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:28.280006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:28.280849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] RBAC: Adding query filter params (interface=public, service_id=a2898bf6b9384033b3611779064f1df1, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:28.281161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:28.282711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:28.331246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 388/777] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:28 2022] GET /identity/v3/endpoints?service_id=a2898bf6b9384033b3611779064f1df1&interface=public®ion_id=RegionOne => generated 194 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:28.334214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:28.477736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699a1c-0edf-4777-8cfd-e96b6ddd2b79 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:28.522574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:28.552167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61449c-c08a-4d0b-8814-12320c0c0fd9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:28.556851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:28.557529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:28.557812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:28.558160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:28.559077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] RBAC: Adding query filter params (interface=public, service_id=e7277ce5ad904dcca208abcd65c2ecf9, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:28.559430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:28.560849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:28.579534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 390/778] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:28 2022] GET /identity/v3/endpoints?service_id=e7277ce5ad904dcca208abcd65c2ecf9&interface=public®ion_id=RegionOne => generated 194 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:28.584210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:28.606407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:28.623955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:28.624701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:28.624985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:28.625263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:28.625944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:28.627335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b015-2584-4c8c-8a9d-ed02949fbdb6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:28.638141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 389/779] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:28 2022] GET /identity/v3/services => generated 772 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:28.787564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd30e72-e375-4591-b227-4611ff4475f7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:28.853123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:28.853723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:28.854013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:28.854293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:28.855007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:28.856496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345296-140b-4f63-8d44-a583100fb88f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:28.866395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 391/780] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:28 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:29.256040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18c37-80d0-4745-a875-50a629730618 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.256487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18c37-80d0-4745-a875-50a629730618 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.256684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18c37-80d0-4745-a875-50a629730618 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.258252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 390/781] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:29.263956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8bc7-26e5-49ee-b9b4-c9590207f8ae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.264255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8bc7-26e5-49ee-b9b4-c9590207f8ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.264570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8bc7-26e5-49ee-b9b4-c9590207f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.289663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1fcb8bc7-26e5-49ee-b9b4-c9590207f8ae None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:29.290870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1fcb8bc7-26e5-49ee-b9b4-c9590207f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:29.363904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:29.398668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 392/782] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:29.433091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e18c37-80d0-4745-a875-50a629730618 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:29.571740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc262c-4b18-4f75-a3c1-2ad329090361 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.572252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc262c-4b18-4f75-a3c1-2ad329090361 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.572252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc262c-4b18-4f75-a3c1-2ad329090361 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.573853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 393/783] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:29.580177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.580736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.580842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e18c37-80d0-4745-a875-50a629730618 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:29.581312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.614506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:29.615239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.615520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.615794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.625820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:29.626295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:29.627570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:29.636361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:29.637423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:29.638264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:29.638917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 391/784] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:29.645862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:29.712845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:29.754889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68310ff7-20fc-4279-9fb8-e53960f4cef5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:29.775268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 394/785] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:29.789170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:29.789850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:29.790131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:29.790401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:29.791150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:29.791449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:29.792939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:29.801616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 392/786] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:29.807172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:29.810021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:29.995081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7c02-f442-4f62-b2fa-0b566d08d9e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.013574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05110d3-3f11-463f-a323-829950313dc5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.015238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.024980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.041071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.041885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.042167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.042440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.051829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.052653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.052935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.053205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.053443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-add0acc4-d299-475f-826e-3d99f78c6dc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:30.061938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.062848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:30.063705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:30.064354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.064426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 393/787] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.065303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.065414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f00bc-f606-432d-ad90-554eb5b9b586 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.065414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f00bc-f606-432d-ad90-554eb5b9b586 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.065544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f00bc-f606-432d-ad90-554eb5b9b586 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.070983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 394/788] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:30.071860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f00bc-f606-432d-ad90-554eb5b9b586 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e324e72a-5538-4764-bf71-dfdcdf90e514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:30.082846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.084997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.087236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:30.087236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:30.087236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.087236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:30.087236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 395/789] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.092471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.092471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.092471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.108010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:30.109413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:30.176921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f00bc-f606-432d-ad90-554eb5b9b586 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.177285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 396/790] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:30.178111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.237025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.237807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.238093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.238372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.239135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:30.239440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.241074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.250664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 395/791] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:30.251446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.278417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.291506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f8a5-144a-4825-81ba-0fdce5e34d9a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.304890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.331267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.332723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.333322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.333815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.334747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:30.335258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.336946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.349670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 397/792] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:30.350854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.363971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def3856-ffbb-4016-889f-4d35d41ca6fe None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.399808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.400996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.401486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.401983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.413145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:30.421464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.422384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:30.423240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:30.430750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 396/793] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.431888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.454730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94732c-b2cf-425d-9f32-f95573078bfc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.500367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.501413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.501720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.502053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.512894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.514360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:30.531632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.532576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.533483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:30.533483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:30.533483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.533483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:30.535798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.537573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 398/794] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.538419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.541213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.546882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457169dc-e997-48e9-a024-5a3213c19fe6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.582070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.583529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.583987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.584470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.593259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.594987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:30.610117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.611098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:30.612056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:30.614722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 397/795] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.615872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.652644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9af6a-00bf-4159-bf8a-f22f2fe29a38 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.690408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.691378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.691818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.692239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.693165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:30.693617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.695233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.705037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 399/796] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:30.706148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.725401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb067-f059-46aa-ab4c-a9c6d5863221 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.762962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.763987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.764475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.764930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.765933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:30.766417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.767979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.781776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 398/797] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:30.782976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.788418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.802100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:30.844467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4c2e1-5b87-4b60-bdcd-1e66920d96e5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.890133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.891059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.891355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.891639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.892922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:30.893238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.894986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.895823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10deb86-428d-4635-a764-d3fc83d3d333 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:30.919577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 400/798] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:30.920863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:30.934680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:30.935953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:30.936565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:30.937039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:30.948676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:30.950526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:30.970119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:30.971040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:30.971934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:30.971934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:30.971934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:30.971934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:30.978617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 399/799] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:30.979804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.035909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343720d-f071-4b0b-a434-6cbee7cf3043 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.049700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.060728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.073695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.074888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.075419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.075840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.084485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.086237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.091365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e0b98-51b2-45c8-8048-690d9048bf9a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:31.102452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:31.103439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:31.104374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:31.107290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 401/800] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:31.108263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.128757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.129758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.130107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.130450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.141782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.143600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:31.162995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:31.163941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:31.164872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:31.164872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:31.164872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:31.164872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:31.164872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 400/801] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:31.165774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.220297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a527a9-42d8-4979-89ce-1f8aacccb161 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.255726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.256403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.256717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.256998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.257727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:31.258037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.259436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.270048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d6b5d-2116-4d67-9ccf-64f04f0c920a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.271400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 402/802] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:31.272263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.288356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.305917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.306601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.306902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.307140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.308175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:31.308538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.309984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7f5a-4d04-489c-a1cc-9d077ebf2fa6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.316126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.327773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 401/803] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:31.329139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3baa-0fad-4888-9c0f-9568021d8d60 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.329422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3baa-0fad-4888-9c0f-9568021d8d60 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.329682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3baa-0fad-4888-9c0f-9568021d8d60 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.331091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 402/804] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:31.337562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270861-a5fe-42e9-a342-12a3354cc8c2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.337845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270861-a5fe-42e9-a342-12a3354cc8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.338105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270861-a5fe-42e9-a342-12a3354cc8c2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.339336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 403/805] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:31.340069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270861-a5fe-42e9-a342-12a3354cc8c2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.374805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d3dd2-f122-4060-bb7a-83e9ea7b2f3a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.412034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.412763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.413038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.413316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.414052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:31.414359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.415770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.428931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 403/806] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:31.429833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.539510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa74a-44e0-446a-b79b-806a5583c648 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.540947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.559757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270861-a5fe-42e9-a342-12a3354cc8c2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.574642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.575448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.575728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.576007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.586930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.588476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.592710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.593502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.593782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.594053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.601544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.602979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-24b04ebe-7cbd-4c9e-89ec-99169372d7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:31.605336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:31.606191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:31.607104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:31.607104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:31.607104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:31.607104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:31.607104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 404/807] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:31.607796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.608037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.608319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0b46e426-1bd3-4745-848e-b9d119f1a237 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:31.617110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:31.618024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:31.618949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 404/808] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:31.619548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.619758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.620306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.628078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:31.629292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:31.635698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:31.636920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:31.665636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.694722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 405/809] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:31.695550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.713606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 405/810] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:31.721362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.779552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.795814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd0f0f-81af-4b1d-9a73-f304704b7195 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.819523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847c2f2-1a66-4e03-87ce-42c38731051c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.829385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.830193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.830471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.830737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.837569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.839011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:31.852689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:31.853698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 406/811] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:31.854814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.856858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.857748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.858080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.859149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.859959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:31.860329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.861760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:31.873309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 406/812] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:31.874091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:31.901156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:31.951194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab6ed5-e775-47e9-af10-9ce330191035 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.972135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa67a-64e7-4211-9fd5-e9aa6304f4d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:31.984852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:31.985533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:31.985815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:31.986088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:31.986930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:31.987246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:31.988732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.005844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 407/813] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.006765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.007668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.008484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.008806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.009090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] PATH_INFO: `/v3/services/network` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.009538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.009941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.012247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:32.024555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:32.025614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:32.026443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 407/814] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:31 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:32.027272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.114655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebd1f2-8fdf-486e-b74a-2814f451076c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.118170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.129568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646b96-aab1-4dee-911e-e576e16aa859 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.150029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.150847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.151125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.151396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.152075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.153495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.163950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.164715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.164996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.165269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:32.165402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:32.166343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 16:00:32.167177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:32.168051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.168051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.168186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 408/815] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:32.168186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.168324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.180683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 408/816] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.181448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.242779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.278136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccea1-a4fe-4d93-aca8-f69184db09c5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.282190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fe8ce-2ed8-4f51-9635-f1c39c8a8c97 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.314182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.314998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.315277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.315554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.316552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.317196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.317478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.317742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.322365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.323815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.336300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:32.338157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:32.339206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:32.340245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 409/817] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:32.340773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.388904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.390272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.437080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b928d-01e9-440d-b0e9-c74a415edebd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.462765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.472568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.473264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.473546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.473818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.474516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.474827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.476222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.485330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 410/818] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.485330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.495694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 409/819] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:32.496591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.542930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.586018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7feba-2ac3-442a-a4df-1b691b55008b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.592168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5765-397c-488c-b3a7-38735e81c08d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.618944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.619637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.619902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.620188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.620969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.621275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.622668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.625586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.626484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.626768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.627041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 411/820] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.627127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/f0eaf162fd3647a0963e00de33419559/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.627850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.629337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=f0eaf162fd3647a0963e00de33419559, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.630939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.645261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 410/821] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:32 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/f0eaf162fd3647a0963e00de33419559/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:32.645984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.686341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.738221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7f07-1694-46e3-acea-4c5f6224020f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.761553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7cfb-9f91-4a6b-9bbb-94449325fa74 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.774419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.778576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.780526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.781778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.782232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.783193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.783649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.785296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.800645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 412/822] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.801516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.811244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.811969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.812301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.812606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.813329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] RBAC: Adding query filter params (type=network) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.813627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.815020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.821606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 411/823] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.822564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.911928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e68b1-14bc-4649-9128-b16cbc5f8fb1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.925059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff005e-e668-417b-9685-6b02a458cbee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:32.929186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:32.951669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.952993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.953408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.953666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.959633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:32.960307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:32.960619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:32.961297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:32.962023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:32.962327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.964097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.964578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:32.966014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:32.973910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 412/824] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:32.973910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:32.986124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:32.987160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:32.988234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:32.988234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:32.988234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:32.988234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:32.989637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 413/825] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:32.990584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.018273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:33.080132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0132c-d4a6-497d-898b-9febf7146e6e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.097914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab694-89c6-4763-bc2d-873283217086 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.116944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.117838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.118360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.118360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/cfc40069aff94b77a542e3c02eea4c79/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.132187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.132889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.133173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.133450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.134195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.134415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=cfc40069aff94b77a542e3c02eea4c79, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.135579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.135834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.150756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 413/826] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:32 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/cfc40069aff94b77a542e3c02eea4c79/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:33.151554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.173008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 414/827] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:33.173973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.245952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:33.341704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:33.363493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc59-0686-4d36-8d45-3a12c461761d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.408009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d0d9-4baa-4767-b501-78e678ad31ea None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.413581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.414260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.414538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.414881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.416278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.418040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.457535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 414/828] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:33.476747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.477538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.477818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.478140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.480560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:33.480560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.482393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.495336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 415/829] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:33.500999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.621026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a523b-835a-43d2-9a0f-1fb6abf44da6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.667063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.668307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.668888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.669353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.678957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.680415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:33.695785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:33.696739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:33.697690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 415/830] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:33.703028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.781574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:33.806632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590bbe8-7586-4a51-b3b0-758b13ca1bf7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:33.840812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:33.841486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:33.841766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:33.842043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:33.842834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:33.843144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:33.844611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d155a-5183-47e7-b7f5-a5f6a7b5ed4c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:33.857262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 416/831] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:33.863207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:33.867575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:33.969609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb859-4ef7-4249-942b-213a0b09296c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:34.003583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:34.004247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:34.004548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:34.004825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:34.005796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:34.006106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:34.007551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8cb1-8701-44c5-bbf0-6143a2ad09ae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:34.014035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 416/832] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:33 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:34.693822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cae3-f65a-4efb-a2b4-38c5dbe1301f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:34.694208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cae3-f65a-4efb-a2b4-38c5dbe1301f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:34.694385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cae3-f65a-4efb-a2b4-38c5dbe1301f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:34.695904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 417/833] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:34.701451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:34.702300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:34.702777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:34.720577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:34.722100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:34.786052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:34.796611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 417/834] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:34.815398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678cae3-f65a-4efb-a2b4-38c5dbe1301f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:34.922568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678cae3-f65a-4efb-a2b4-38c5dbe1301f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:34.956566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:34.957993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:34.958424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:34.958832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:34.960826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:34.969767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:34.977616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:34.978726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:34.979644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 418/835] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:34.985598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.088551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f3f5c-303d-4738-830f-6f710e136e63 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.122816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.123496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.123773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.124045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.124814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:35.125119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:35.126501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:35.135452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 418/836] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:35.141623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.251977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887db3d-45af-4a85-ba7f-1267bc5cf1b9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.285931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.286736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.287016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.287286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.298182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:35.299631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6b6eceec-55dd-4ad7-899f-5042b3f47328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:35.316876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:35.317809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:35.318713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:35.318713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:35.318713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:35.318713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:35.318713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 419/837] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:35.325552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.388326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:35.415294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2fe-2038-4a70-ba9d-e2f71e748d80 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.415611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2fe-2038-4a70-ba9d-e2f71e748d80 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.415853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2fe-2038-4a70-ba9d-e2f71e748d80 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.417721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 420/838] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:35.422818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.423339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.423811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.432869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c098c-040c-4860-b0f9-2d43e68f3afd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.443655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:35.445443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:35.467828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.474366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.474645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.475397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.476159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:35.476488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:35.478167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:35.500751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 419/839] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:35.502205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.512873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:35.531795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 421/840] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:35.555948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.612796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19abcf-01b1-48b2-a14f-2063559cd4a2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.635812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:35.650416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.651150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.651430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.651704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.659201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:35.661047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-f612a236-b20c-4acb-839c-c6d770256077 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:35.675124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:35.676086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 16:00:35.677104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:35.680756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 420/841] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:35.681943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565c84-44e7-4247-82b5-5e913e2fcd7b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.682217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565c84-44e7-4247-82b5-5e913e2fcd7b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.682492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565c84-44e7-4247-82b5-5e913e2fcd7b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.683781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 421/842] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:35.684465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4565c84-44e7-4247-82b5-5e913e2fcd7b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.687149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cfbfc-06a3-42ab-ab70-96d067a3e27f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.729988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.730836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.731115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.731380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.744862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d715cc27-e593-420c-9dc7-0e113ff1ed7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:35.755017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:35.755978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:35.756877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 422/843] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:35.758109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.758109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.758263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.778766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:35.780243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:35.798774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4565c84-44e7-4247-82b5-5e913e2fcd7b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.812470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:35.837216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:35.837893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:35.838176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:35.838454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:35.839293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:35.839606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:35.841102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:35.866346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 423/844] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:35.866867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 422/845] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:35.866959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.867041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:35.904112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:35.966873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f3653-6bb7-43a6-94cc-9d6d3bfe05a4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:35.976254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824d56-5b53-41ce-915f-a85eb52ba8e3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.002937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.003593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.003875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.004178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.011072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.012054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.012555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.012832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.013579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:36.013882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.015255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.028492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 424/846] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:36.028492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.058161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.078915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.080383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.118700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.129781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d55b5b-c089-4fd4-8933-5d32976fa15f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.163547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.164295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.164618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.164904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.165569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.166963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.177323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 423/847] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 16:00:36.178146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-51959ca7-efe5-4789-953b-1ec8d5bcb5f4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.178874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.179826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.181257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 425/848] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.182575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7359bb-4b6e-4dfd-b057-14a3591dcfc5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.182575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7359bb-4b6e-4dfd-b057-14a3591dcfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.182575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7359bb-4b6e-4dfd-b057-14a3591dcfc5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.184692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 426/849] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:36.185642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7359bb-4b6e-4dfd-b057-14a3591dcfc5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.275912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f25-6c11-4327-af3e-0b721a4bf15a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.280275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.291064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7359bb-4b6e-4dfd-b057-14a3591dcfc5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.308827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.309608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.309887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.310156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.316606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.321366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.323186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.325494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.326292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.326576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.326849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.337377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.338842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:36.343283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.344156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.345073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:36.345073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:36.345073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:36.345073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:36.345073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 424/850] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.345379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-681e0aa7-8882-4157-b894-62eaef675b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:36.360502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.361451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.362428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:36.362428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:36.362428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:36.362428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.362428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 427/851] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.362921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.363174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.363482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.380372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:36.381598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:36.447754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336569e-618f-4498-9e86-2a0d4dee3e52 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.449230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 428/852] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:36.449900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.487826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.488529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.488808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.489084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.489794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:36.490321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.491470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.496161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 425/853] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:36.496884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.536901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.551795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.563937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2c17-9b45-4b69-b3da-b766d1c09770 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.602588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.603014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d8a3-a2d0-4451-a7b5-a6d82f3deae1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.603214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.603499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.603780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.604545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:36.604859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.606382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.617706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 429/854] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:36.618494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.635605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.636336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.636645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.636923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.637647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:36.637952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.639323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.650265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 426/855] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:36.651242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.716461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756528-fec3-4ac1-8a68-ee8bb2330ec8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.746874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce222-3359-4c14-ac63-b6ec9c44b044 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.749430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.750241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.750516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.750776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.751425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.752832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.754560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.761168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.766706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.767634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.768506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 430/856] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.769400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.786700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.787368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.787646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.787923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.788659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:36.788960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.790323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.794950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 427/857] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:36.795566 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.883580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc451b-3c55-44b7-9a1e-18f7bb9645c0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.908388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd384f-551b-473d-9593-c6dbf50c1adb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:36.922885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.923994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.924417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.924875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.933736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.935527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.944402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:36.945252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:36.945532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:36.945810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:36.951996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.952983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:36.953933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 431/858] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.954522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:36.955323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:36.956958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:36.973071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:36.973997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:36.974890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 428/859] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:36.975376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.014523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.017672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.061824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038673-1e73-467a-9868-f54f16311473 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.081199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ab17-28b1-4fd5-a345-32906ca4f41d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.099072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.100002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.100534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.100809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.101523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:37.101828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.103200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.107827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 432/860] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:37.108639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.123386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.124319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.124841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.125052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.125865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:37.126174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.127912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.151371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 429/861] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:37.152173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.211709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ada6-ffec-460c-b11b-b7c1470fe8fe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.234032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.246659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.247333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.247614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.247889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.248707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:37.249019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.249902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.250467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.256732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef9629-b2be-4217-ab44-345b348a49d3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.266053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 433/862] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:37.267135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.296488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.297183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.297435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.297711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.298429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:37.298734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.300109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.312493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 430/863] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:37.312493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.394554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715c71-3dba-4087-8b46-6f888392127b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.419512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c051c65-d60a-4697-919e-45b28b3f3e08 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.439845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.440596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.440879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.441154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.458599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.459435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.459813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.460185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.461299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=f0eaf162fd3647a0963e00de33419559) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:37.461820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.463369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.470832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 431/864] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/role_assignments?user.id=f0eaf162fd3647a0963e00de33419559&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:37.529603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.553219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.555097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.672034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 434/865] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:37.677447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.705921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.785429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988b6-cad7-474e-8ffe-ebb682fd728c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:37.821735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:37.822847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:37.823339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:37.823841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:37.835209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:37.836967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:37.855256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:37.856199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:37.857145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:37.857145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:37.857145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:37.857145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:37.859170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 432/866] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:37.864713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:37.951929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:37.971020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20310950-a0b9-4538-9fe8-28c984b4bc19 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:38.007222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:38.007901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.008186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.008482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.009217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:38.009525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:38.011022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:38.022764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 435/867] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:38.027981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:38.111742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:38.134538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a5d5-d3f7-4a78-a3ff-bcbda0bccf3e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:38.168399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:38.169237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.169518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.169795 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.176593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:38.178059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:38.191728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:38.192649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:38.194265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 433/868] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:38.198750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:38.301023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17138833-5a5d-4aaa-94f3-f51badc87603 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:38.337201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:38.338209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.338684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.339168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.340262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:38.340935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:38.342657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2252919-33a4-425c-adbd-1fa9114d11f7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:38.358098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 436/869] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:38.366734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:38.467716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24a40b-4f1d-49ae-9e02-f673f39ab090 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:38.504211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:38.504915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.505201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.505482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.506326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=cfc40069aff94b77a542e3c02eea4c79) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:38.506641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:38.508092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085233a-3674-4ba8-8526-18a0ea84d475 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:38.511169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:38.515167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 434/870] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:38 2022] GET /identity/v3/role_assignments?user.id=cfc40069aff94b77a542e3c02eea4c79&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:38.888122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a118d-66b9-4ede-8547-e70b1ab2435f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.888882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a118d-66b9-4ede-8547-e70b1ab2435f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.889390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a118d-66b9-4ede-8547-e70b1ab2435f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.891244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 437/871] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:38.896855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ed2-f97e-47df-9393-92731a5fd336 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:38.897403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ed2-f97e-47df-9393-92731a5fd336 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:38.897885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ed2-f97e-47df-9393-92731a5fd336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:38.915215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2eed0ed2-f97e-47df-9393-92731a5fd336 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:38.916722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2eed0ed2-f97e-47df-9393-92731a5fd336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:38.987122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 435/872] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:39.009507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a118d-66b9-4ede-8547-e70b1ab2435f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:39.013399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:39.118297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a118d-66b9-4ede-8547-e70b1ab2435f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:39.153629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:39.154278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.154562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.154844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.155675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:39.157169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0fb78-9139-4752-a048-3cca750372ad None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:39.174533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 438/873] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:39 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:39.392241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaada13-9919-4c1e-8b25-1263cf0810be None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.392956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaada13-9919-4c1e-8b25-1263cf0810be None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.392956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaada13-9919-4c1e-8b25-1263cf0810be None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.394481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 436/874] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:39.399769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c8c3-bde4-431c-a78c-4181a34948a7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.400061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c8c3-bde4-431c-a78c-4181a34948a7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.400335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c8c3-bde4-431c-a78c-4181a34948a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.419372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7260c8c3-bde4-431c-a78c-4181a34948a7 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:39.420481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7260c8c3-bde4-431c-a78c-4181a34948a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:39.476942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:39.497413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 439/875] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:39.519239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaada13-9919-4c1e-8b25-1263cf0810be None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:39.624669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaada13-9919-4c1e-8b25-1263cf0810be None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:39.654252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:39.660530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:39.661211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.661541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.661820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.662567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:39.664067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f8b2c-621f-4794-98ee-fd7bd8a7c781 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:39.682926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 437/876] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:39 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:39.693796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f87d0-ae60-4e03-9aab-7fcc51e565cc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.694154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f87d0-ae60-4e03-9aab-7fcc51e565cc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.694495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f87d0-ae60-4e03-9aab-7fcc51e565cc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.696483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 440/877] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:39.702836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.703186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.703479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.724133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:39.725597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:39.807557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 438/878] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:39.830598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f87d0-ae60-4e03-9aab-7fcc51e565cc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:39.939500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f87d0-ae60-4e03-9aab-7fcc51e565cc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:39.975537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:39.976413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:39.976731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:39.977009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:39.977725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:39.979109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:39.991393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:39.992360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:39.993233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 441/879] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:39.999070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:40.099404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2badc1e-7b5e-488d-9c81-21c628b1801e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:40.116145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:40.134208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:40.134885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:40.135175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:40.135456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:40.136429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:40.136687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:40.138100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32873a-474c-4bc4-8038-a105d80df0d0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:40.143493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 439/880] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:40.149260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:40.204239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:40.256320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48cdd3-8041-4fd0-81cb-a22db707a6bb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:40.290858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:40.291529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:40.291809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:40.292083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:40.292999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:40.293305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:40.294683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd714-9747-4147-ada8-6a736fc671c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:40.299794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 442/881] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:40.673261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9b6bd-57ae-4c88-80c4-8622b95419b3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:40.674323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9b6bd-57ae-4c88-80c4-8622b95419b3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:40.674812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9b6bd-57ae-4c88-80c4-8622b95419b3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:40.676692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 440/882] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:40.682040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:40.682546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:40.683123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:40.700118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:40.701646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:40.770052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 443/883] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:40.793660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9b6bd-57ae-4c88-80c4-8622b95419b3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:40.897603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9b6bd-57ae-4c88-80c4-8622b95419b3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:40.930628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:40.931448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:40.931794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:40.932111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:40.942635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:40.951068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:40.951997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:40.952881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 441/884] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:00:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:40.960321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.005656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.059642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8487-bab7-4505-afba-c1d568fcf1f2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.094434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.095406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.095865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.096335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.097293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:41.097789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.099368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921716bd-419e-4acf-872c-98e6f2b05787 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.108439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 444/885] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:00:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:41.114284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.157649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.217504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ba3e-0efa-4e47-815c-bd26796220f9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.248715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a58d0-b772-4ac2-9366-f49ffaa697ba None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.249656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a58d0-b772-4ac2-9366-f49ffaa697ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.250132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a58d0-b772-4ac2-9366-f49ffaa697ba None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.251425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.255601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.255601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.255601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.256116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 445/886] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:41.257865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.258350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.258817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.265056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.266528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.275945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:41.277634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:41.284398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:41.285371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:41.286643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:41.286643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:41.286643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:41.286643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:41.286643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 442/887] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:41.291362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.364551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 446/888] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:41.381441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.401162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.410758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562e8f-3d18-490d-95b1-b21b3737a8ef None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.433520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.458934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.459881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.460170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.460473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.461218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:41.461528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.462909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.492513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 443/889] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:41.496802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.508884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9eb-5b00-456a-a9c9-190769eb7859 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.544839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.545902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.546334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.546769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.547566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.549208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:41.561947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:41.562950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:41.563790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:41.571384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 447/890] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:41.572848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.619459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff9698-71c1-4800-a315-7a8e7208ff45 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.661934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.662854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.663203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.663547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.673068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.675352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.677841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9984999-4858-4e88-a48f-ffcc79cd76ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.679600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:41.694593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:41.695618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:41.696608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:41.700817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 444/891] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:41.701780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.721192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.721352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.722268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.722758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.723241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.724153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:41.724776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.726448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.736612 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 448/892] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:41.738138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.819809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41135337-6ee2-4958-9b2f-1238ce781aa1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.854798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262d7e-dde8-406d-9189-d8798ac0687e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:41.859751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.860706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.861204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.861769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.862741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:41.863188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.865017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e38e0-45be-4a1d-8e7b-ff7ccc429864 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.884571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 445/893] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:41.885025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362c48-da12-457a-90c1-c889208523b2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.885247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362c48-da12-457a-90c1-c889208523b2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.885520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362c48-da12-457a-90c1-c889208523b2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.890713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 446/894] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:41.890713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362c48-da12-457a-90c1-c889208523b2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:41.896003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:41.896723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.897008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.897511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.898000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:41.898300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:41.899685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f30f4-5378-41a4-b671-da7a763533ff None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:41.905586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 449/895] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:41.906667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:41.906955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:41.907233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:41.923509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:41.924793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:41.949749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.965909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:41.997581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 450/896] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:41.998698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.000407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362c48-da12-457a-90c1-c889208523b2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.041419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.042074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.042387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.042661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.112365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.113489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d391236-91c8-4d87-84a8-df271fd311af None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.113857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.149150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.149747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.150029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.150305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.151102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] RBAC: Adding query filter params (interface=public, service_id=a167b326180f40c5adc09485ac67a4fd, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:42.151413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.152909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.158398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 451/897] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/endpoints?service_id=a167b326180f40c5adc09485ac67a4fd&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:42.159023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.184695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.192183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.227293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 447/898] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:41 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:42.228365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.270992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c0df1-1bf9-466b-8e20-9b1b92381936 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.307977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.308829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.309113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.309390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.310047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.311433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:42.323748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:42.324977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:42.325816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 452/899] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:42.326645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.339053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fc73-1ad1-468f-b381-004556fbe12d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.376071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.377193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.377650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.378135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.378986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.381057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.388032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 448/900] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:00:42.388856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.428867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.433695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.453133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b72d4-3e91-4adc-95ba-71a0887388fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.494973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.495962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.496248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.496556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.508065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.509599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.513662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5edd2-f78b-4877-ad8c-45b2e3870e41 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d26999f8-a938-45cf-b4c4-5cf848167df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:42.529213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:42.530302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:42.531289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:42.531289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:42.531289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:42.531289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:42.535377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 453/901] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:42.536903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25945e-e58c-41e7-b978-f1a90957a2ed None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.537194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25945e-e58c-41e7-b978-f1a90957a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.537472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25945e-e58c-41e7-b978-f1a90957a2ed None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.538825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 454/902] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:42.539502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25945e-e58c-41e7-b978-f1a90957a2ed None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.564301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.565011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.565284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.565564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.566270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:42.566572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.568388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23f2f6-ac34-43c2-bba5-11792d6809e5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.573298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 449/903] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:42.574569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.574851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.575123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.591543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:42.592756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:42.655493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25945e-e58c-41e7-b978-f1a90957a2ed None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.659488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 450/904] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:42.660427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.691297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.696275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.697804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.698520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.698947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.699820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:42.700270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.701812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.711329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.716050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 455/905] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:42.720497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.769935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ee921-7325-4dd3-a35a-550e1f30081d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.803791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.804485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.804768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.805041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.805748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:42.806051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.807426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.812858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 451/906] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:42.813640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.824328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a1e7-a1c7-4664-8b3e-fa77018a20ac None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.864846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.866098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.866582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.867030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.868345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.869763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.888487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 456/907] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:42 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:42.888487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:42.912569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:42.924410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a2ea-0227-4f3b-9942-d3a5b1b6e8c4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:42.978125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:42.979163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:42.979447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:42.979776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:42.988404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:42.990003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:42.991873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:43.009429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:43.010410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:43.011369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:43.016076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 452/908] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:43.017051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:43.051238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9361e49-9b0f-4641-b6e1-1ebd609490ec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:43.098455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:43.099278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:43.099565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:43.101328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:43.101451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] RBAC: Adding query filter params (interface=public, service_id=ea2d1153500f47a39e5987116667b295, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:43.101766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:43.103161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:43.113634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 457/909] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:42 2022] GET /identity/v3/endpoints?service_id=ea2d1153500f47a39e5987116667b295&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:43.114836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:43.141945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dddfdf-4d2e-48b9-9dcc-38e3b47013f7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:43.183367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:43.184416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:43.184948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:43.185419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:43.186404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:43.186930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:43.188600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:43.201785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 453/910] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:43.212069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:43.228743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:43.242810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7e92-4a38-4da0-b523-3141f3ddc3b2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:43.272598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:43.287514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:43.288219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:43.288528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:43.288808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:43.289518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:43.291586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72372331-7731-45ad-8704-7e1d5420d5c8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:43.299777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 458/911] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:43 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:00:43.347943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88fec-b58b-4179-a762-ca40651fe7a4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:43.388874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:43.389953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:43.390455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:43.390937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:43.391982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] RBAC: Adding query filter params (role.id=fdef9ab126e348a4abdef87ac1f7b121, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=cfc40069aff94b77a542e3c02eea4c79) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:43.392517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:43.394284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe521090-060f-4086-8742-45ba8d5dfde7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:43.401559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 454/912] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:43 2022] GET /identity/v3/role_assignments?user.id=cfc40069aff94b77a542e3c02eea4c79&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=fdef9ab126e348a4abdef87ac1f7b121 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:44.454818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4661-501e-47fa-a7a0-9c2b294d83e6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:44.455392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4661-501e-47fa-a7a0-9c2b294d83e6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:44.455392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4661-501e-47fa-a7a0-9c2b294d83e6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:44.457417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 459/913] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:44.462726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:44.463156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:44.463328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:44.491501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:44.492988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:44.568891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 455/914] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:44.595545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4661-501e-47fa-a7a0-9c2b294d83e6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:44.700323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4661-501e-47fa-a7a0-9c2b294d83e6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:44.735820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:44.736597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:44.736878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:44.737156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:44.737806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:44.739185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:44.751098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:44.752053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:44.752941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 460/915] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:44.761893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:44.770136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:44.860962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ae7d-522a-4200-941e-243462816e31 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:44.896467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:44.897143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:44.897423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:44.897798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:44.898511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:44.898811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:44.900221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103347e-69a9-453b-8511-eefe9ffc661e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:44.905813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 456/916] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:44.912947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:44.974562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.022887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc88e-92ae-4d57-bdd3-a653a992ceb0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.027056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00c36-56dd-49e5-9b0b-e9c5bf9df60f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.027346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00c36-56dd-49e5-9b0b-e9c5bf9df60f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.027627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00c36-56dd-49e5-9b0b-e9c5bf9df60f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.030310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 457/917] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:45.034360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.034651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.034932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.052941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:45.054625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:45.060063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.060858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.061141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.061422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.062132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:45.062445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.063831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.073837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 461/918] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 5 16:00:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:45.075153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.127600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.144601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 458/919] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:45.161233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.184264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1bbe-231f-4273-89c5-7dacf3891873 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.204186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.226025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.226842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.227184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.227521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.228417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.230016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.255626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 462/920] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:45.271385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709af86-19da-4ac9-ab30-c4baacd4f530 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.316808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.317564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.317843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.318176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.318854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.320402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7fb04c67-b73a-4840-937b-f02efde7eb43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:45.334331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:45.335407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:45.336287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.340586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 459/921] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:45.342576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.375269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b7aa1-a1f7-44de-8c93-5332b5daa071 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.375583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b7aa1-a1f7-44de-8c93-5332b5daa071 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.375837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b7aa1-a1f7-44de-8c93-5332b5daa071 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.377441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 460/922] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:45.382722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.382999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.383287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.401600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:45.402833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:45.465387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a7834-5cc1-4ed0-8fa3-663d6fca984a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.471755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.493496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 461/923] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:45.517156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.525852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.527006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.527980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.528526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.529866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:45.530648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.532568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.540262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 463/924] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:45.545812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.583893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.635292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b670374-912e-4283-9a8d-6bc5d5622e8c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.656621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b20e-a8e7-4e4b-a7c6-ddb786946f28 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.671373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.672210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.672521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.672797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.673472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.674848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0704814e-fa8f-427d-853c-95da25a2766e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:45.687135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:45.688284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:45.689335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 462/925] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:45.690360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177e63-0e96-4ed0-9ed9-47274191de7e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.690360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177e63-0e96-4ed0-9ed9-47274191de7e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.690504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f177e63-0e96-4ed0-9ed9-47274191de7e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.691709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 463/926] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:45.694255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f177e63-0e96-4ed0-9ed9-47274191de7e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.701271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.702026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.702318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.702645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.703376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:45.703689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.705576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3610d2-8559-4176-95d9-3bb79e32cad3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.714844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 464/927] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:45.714844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.714844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.714844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.732164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:45.733393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:45.757242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.805305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 465/928] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:45.805987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.818987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f177e63-0e96-4ed0-9ed9-47274191de7e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.836865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:45.857018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.857743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.858019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.858326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.859042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:45.859351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.860834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.870161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 464/929] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:45.870161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.916882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688bb53-e289-4a5a-9421-96cebff1f3a6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.952575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:45.953304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:45.953578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:45.953855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:45.954737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] RBAC: Adding query filter params (interface=public, service_id=58009b7f86a74a188da69870c553a376, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:45.955050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:45.956427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:45.962176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 466/930] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/endpoints?service_id=58009b7f86a74a188da69870c553a376&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:45.962993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:45.983913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4221-3d8b-4231-b6a0-42df6ced6439 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:45.998668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.019956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.020799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.021241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.021362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.031850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:46.040114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:46.046322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 465/931] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:46.047251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.068568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.076626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eaaae-096d-481f-a56f-4e6108388935 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.112197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.112834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.113121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.113406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.114115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:46.114422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.115803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.126022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 467/932] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:46.126022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.148252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aad0-0ef7-4b11-846c-926f69731825 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.183593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.184266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.184578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.184859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.185650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.187152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.200750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 466/933] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:00:46.202039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.235171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55993-1d42-43d6-b1e4-6fc5706393ce None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.249843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.282995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.284135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.284709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.285130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.286246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:46.286733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.289181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.305362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 468/934] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:46.307410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.329043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79df777-be52-42a8-a4f9-5c2f7526e772 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.344692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.378113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.378992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.379281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.379562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.380609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.382651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.410071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 467/935] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:46.454295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a46e-4785-4e30-bf72-77b3f2675f0d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.502391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.503254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.503538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.503813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.516744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.518308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:46.537763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:46.538799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:46.539699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:46.539699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:46.539699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:46.539699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:46.544100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 469/936] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:46.545652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.647866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.656431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680c4d-eef0-4d9a-a105-e147d1440272 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.691804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.692537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.692806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.693080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.693810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:46.694117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.695503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.712561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 468/937] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:46.714164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.781761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:46.816825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4aabd-8cc1-4eb9-ab45-facf4b83785a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:46.850927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:46.851754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:46.852038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:46.852317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:46.860507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:46.862045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:46.877116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:46.878112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:46.879060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:46.882405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 470/938] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:46.884571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:46.984998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e0db-147c-4aa7-a5ea-7fb558cbb702 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.021586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.022275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.022556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.022833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.023677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:47.023986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.025453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.043944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 469/939] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:47.049547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.159361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca8b0-74f2-452a-a88b-b8a362a113fc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.185707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.194209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.195018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.195303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.195579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.206652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.208504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:47.225751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:47.226742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:47.227727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:47.227727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:47.227727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:47.227727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:47.231134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 471/940] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:47.233529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.248929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.341106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c32bf1-8abc-48d1-bc0d-35addfe6b035 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.377261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.378334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.378825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.379318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.380275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:47.380859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.382507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf047-9716-4064-b1dc-a40a15cef916 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.395231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 470/941] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:47.401339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.413276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529f01-e111-4af4-ad96-b31fe067b8a4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.413565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529f01-e111-4af4-ad96-b31fe067b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.413846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529f01-e111-4af4-ad96-b31fe067b8a4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.415529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 471/942] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:47.420130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.420466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.420828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.438616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:47.439852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:47.525007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db1964-1c5b-4ec1-a51a-c4f21418b4b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.528596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 472/943] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:47.542974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.545100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.562027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.563070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.563636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.563920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.572658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.574674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:47.595764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:47.596710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:47.597613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:47.600553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 472/944] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:47.604342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.652172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.655715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a01cc-0276-4d86-ba28-b359bbf30518 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.692250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.693132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.693504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.693873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.694662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.696205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.697769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING keystone.server.flask.common [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 16:00:47.716799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.sql.core [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 16:00:47.716799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 16:00:47.716799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [parameters: {'id': '358a34279c4b4bd48de8cffd367b1269', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 16:00:47.716799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 358a34279c4b4bd48de8cffd367b1269.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 358a34279c4b4bd48de8cffd367b1269. Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 16:00:47.725063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 16:00:47.725917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application yield resource Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application next(self.gen) Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise self.value Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application session.commit() Jul 05 16:00:47.726931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.session.flush() Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application compat.raise_( Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 16:00:47.727846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 16:00:47.728800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application conn.query(q) Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application result.read() Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 16:00:47.731189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [parameters: {'id': '358a34279c4b4bd48de8cffd367b1269', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.733651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:47.735492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 358a34279c4b4bd48de8cffd367b1269. Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 473/945] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jul 5 16:00:47 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:47.738737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.741181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f4dd-f25a-4a8c-9eee-f79dc78ff594 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.791188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.792358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.793393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.793905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.795172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:47.795929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.798297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.799138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.816341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 473/946] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:47.823073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.851982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b9e0-8310-44b7-824d-be78e21b6293 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:47.888127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:47.888990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:47.889262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:47.889528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:47.898044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:47.899711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:47.914261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:47.915209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:47.916082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:47.920298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 474/947] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:47.921587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:47.954137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:47.959843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ffc5-2c81-46bf-8c3e-763f32786ab3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.001142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.002783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.003272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.004001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/cfc40069aff94b77a542e3c02eea4c79/roles/fdef9ab126e348a4abdef87ac1f7b121` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.006833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=cfc40069aff94b77a542e3c02eea4c79, role_id=fdef9ab126e348a4abdef87ac1f7b121)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.009228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85e50-69b3-4f5f-a26a-1e1e669fc94d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:48.036586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae0a45-1931-4785-ac88-a7c4924e3066 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.036955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 474/948] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:00:47 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/cfc40069aff94b77a542e3c02eea4c79/roles/fdef9ab126e348a4abdef87ac1f7b121 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:00:48.065435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:48.079025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.079718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.079998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.080271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.081178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:48.081491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.083371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a283-8636-45c9-81c6-47972302b0b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:48.112752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 475/949] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:48.255747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f121-c14a-405b-91ee-6f93988a265c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.256119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f121-c14a-405b-91ee-6f93988a265c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.256297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f121-c14a-405b-91ee-6f93988a265c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.258086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 475/950] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:48.264056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.264348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.264662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.284548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:48.286413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:48.356110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 476/951] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:48.379429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399f121-c14a-405b-91ee-6f93988a265c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:48.488493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399f121-c14a-405b-91ee-6f93988a265c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.521069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.521890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.522177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.522459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.523123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.524538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:48.537007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:48.538471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:48.539317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 476/952] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:48.547855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:48.651366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788359-c7cd-49eb-98c1-8648b811033c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.661138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:48.686594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.687276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.687558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.687834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.688577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:48.688885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.690266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbbd3-1458-4813-b50e-a4829ca93e3a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:48.695680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 477/953] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:48.701264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:48.710495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde34e-19e3-4997-8080-21198502ecb5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.710787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde34e-19e3-4997-8080-21198502ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.711073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde34e-19e3-4997-8080-21198502ecb5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.715345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 478/954] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:48.718135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.718425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.718704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.736852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:48.739226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:48.740761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:48.824028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 479/955] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:48.834918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da945-df8d-4045-aa75-0ce91dbcdf52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.846449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:48.873055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.873836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.874126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.874511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.875234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:48.875549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.877079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:48.882817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 477/956] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:48.893683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:48.948066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a69ad-a6fd-426f-bc3b-414a2f84d463 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:48.949833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:48.985419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:48.986376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:48.986725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:48.987077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:48.987804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:48.989289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:49.001557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:49.002928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:49.003990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 480/957] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:49.007533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:49.008869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:49.029732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b0e95-8761-481d-ade0-c99ab5f36873 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:49.076773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:49.078196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:49.078651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:49.079075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:49.080204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:49.083189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:49.113153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 478/958] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:49.120586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064143-ec53-4af6-8062-3ad8f38ceec9 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:49.165163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:49.165930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:49.166238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:49.166560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:49.167394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:49.167711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:49.169167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196f0-e1c7-409c-8d29-15639f84bbdb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:49.175195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 481/959] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:49.181725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:49.298942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbda8fb-5e3a-4234-aea5-9571626c4e51 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:49.335526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:49.336216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:49.336530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:49.336814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:49.337530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:49.337839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:49.339259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd7e62-acc0-4602-881b-965bca50af2f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:49.344043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 479/960] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:50.178798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408cfb-ed06-4e7c-ba73-5a7da9831afb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.179374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408cfb-ed06-4e7c-ba73-5a7da9831afb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.179633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a408cfb-ed06-4e7c-ba73-5a7da9831afb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.181445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 482/961] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:50.186728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8ee7-d821-4d65-9951-1c8f4a67bb39 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.187122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8ee7-d821-4d65-9951-1c8f4a67bb39 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.187308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc8ee7-d821-4d65-9951-1c8f4a67bb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.204336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-71dc8ee7-d821-4d65-9951-1c8f4a67bb39 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:50.205574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-71dc8ee7-d821-4d65-9951-1c8f4a67bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:50.207914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.279114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 480/962] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:50.286104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d27aa-d3e6-419d-8d6a-96e87008ab37 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.286396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d27aa-d3e6-419d-8d6a-96e87008ab37 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.286687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d27aa-d3e6-419d-8d6a-96e87008ab37 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.288324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 483/963] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:50.293687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.293978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.294255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.305580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d27aa-d3e6-419d-8d6a-96e87008ab37 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.313468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:50.314668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:50.335607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.403531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 481/964] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:50.418441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d27aa-d3e6-419d-8d6a-96e87008ab37 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.428248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.453903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:50.454978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.455402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.455830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.468213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:00:50.477094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:50.478338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:00:50.479431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:50.487143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 484/965] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:50.488604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.513980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.556975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572226c-8ec3-47a6-b5a2-edae6e97f048 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.582853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.599123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:50.600013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.600532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.600978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.601847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:50.603145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282b3f-214a-48e3-aae0-6fe70ca773e4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.603647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:50.605216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING keystone.server.flask.common [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 16:00:50.617970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.sql.core [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 16:00:50.617970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 16:00:50.617970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [parameters: {'user_id': 'f6adbf97b5ef4c5bad813c9ccc57dedd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 16:00:50.617970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() Jul 05 16:00:50.640735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 16:00:50.641832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application yield resource Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application next(self.gen) Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise self.value Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application session.commit() Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 16:00:50.643002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.session.flush() Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application compat.raise_( Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 16:00:50.644146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 16:00:50.645518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application conn.query(q) Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application result.read() Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 16:00:50.646563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6adbf97b5ef4c5bad813c9ccc57dedd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:50.648035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 16:00:50.649673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 16:00:50.653201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.653850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:50.653850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.653850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.653850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.654347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:50.654347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:50.654347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:50.655005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 482/966] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 5 16:00:50 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:50.658551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.669514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 485/967] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:50.671056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.774128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a16924-1396-49f2-96e8-a36eefa80e2d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.778021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645ab3-1f38-42df-8242-3df61ca0c141 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.808361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:50.809295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.809642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.809778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.810043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.817508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:50.818397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:50.818681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:50.818960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:50.822587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:50.824139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:50.827740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:50.829478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:50.832879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:50.844228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:50.845359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:50.846422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:50.846422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:50.846422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:50.846422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:50.846648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:50.847511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:50.848432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 483/968] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:50.855207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 486/969] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:50.855436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.856562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:50.967701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bb0e-bad3-44a6-a175-4802bbcd7623 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:50.980354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760308d2-00f6-4fa2-817a-c24cbb2f8c37 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.002922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.003668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.003963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.004331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.005125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:51.005445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.006891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.018739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.020123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.020843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.021507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.022931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:51.023759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.025694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.043141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 487/970] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:51.044366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.046465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 484/971] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 5 16:00:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:51.112690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.157281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed9579-35f1-4b07-b736-6f5ea5289daa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.196039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.196920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.197200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.197469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.205784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.207618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-1c09b512-57ed-4803-a9b1-141ed9a06f88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:00:51.223879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:51.224885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:51.226417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 488/972] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:51.231862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.232604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84646a-340d-4ccc-8591-287a7d438e96 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.232892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84646a-340d-4ccc-8591-287a7d438e96 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.233167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84646a-340d-4ccc-8591-287a7d438e96 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.234759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 489/973] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:51.239725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.240004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.240277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.260041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:51.261299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:51.304682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.344182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 490/974] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:51.366642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14f45-efff-471e-af78-4eb5db076984 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.366922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.402312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.402987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.403269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.403542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.404381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:51.404732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.406161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.418876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.429062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 485/975] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:51.430205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.476802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4283-fd1a-458b-b54c-c4623c11be8b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.513573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.514517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.514799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.515071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.515725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.517120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-3e40574b-b8d5-4f7c-be2c-18e8fcd7661a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:51.528923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:51.530120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:51.530960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 491/976] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:51.531749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034676c4-dd4a-4982-a9fc-e4522bf8442e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.531749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034676c4-dd4a-4982-a9fc-e4522bf8442e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.531886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034676c4-dd4a-4982-a9fc-e4522bf8442e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.533060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 492/977] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:51.535867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b8b1-66fd-4f7f-bb69-673ff8d16a7a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.537437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034676c4-dd4a-4982-a9fc-e4522bf8442e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.544757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.571271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.571844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.572120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.572393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.639869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034676c4-dd4a-4982-a9fc-e4522bf8442e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.646411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.647890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.653815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.673564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.674233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.674516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.674801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.675504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:51.675813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.677212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd75bf-df02-4168-93be-e6c466784627 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.681926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 493/978] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:51.683211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.683496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.683800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.699411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:51.700634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:51.752607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 486/979] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:00:51.753463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.762101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.773589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 494/980] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:51.774454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.868821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680de02a-be69-4d2b-a5de-073fa8673c6f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.877078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bce28-36e3-4351-b116-aec7b1e171bf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:51.888518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:51.903368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.904040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.904326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.904638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.905353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:51.905661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.907060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.912046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 487/981] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:51.912840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.915532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:51.916340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:51.916650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:51.916959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:51.927587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:51.930003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:00:51.950654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:51.951889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:51.952842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:00:51.952842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:00:51.952842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:00:51.952842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:51.952842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 495/982] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:51.953147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:51.988435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:52.021963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03cfb-3b65-40dd-b417-e8d5720a01e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.056758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce2d-12ae-466d-a77a-1d029158b691 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.058450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.059125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.059405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.059676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.060525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.061911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.088492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 488/983] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:51 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:52.088492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:52.116353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.117067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.117349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.117808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.119665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=58009b7f86a74a188da69870c553a376, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:52.119976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.121425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.132654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 496/984] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Jul 5 16:00:51 2022] GET /identity/v3/endpoints?service_id=58009b7f86a74a188da69870c553a376&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:52.135144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:52.159667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:52.203948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ea49-286c-4298-b832-b68d5a0a8966 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.238708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:52.248104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.248827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.249108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.249392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.250124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:52.250431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.251820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.255600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1d1dd-32e9-478d-a2ac-1af45677e2b8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.265845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 489/985] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:52.271692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:52.295704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.296828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.297305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.297798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.298943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.300848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.308381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 497/986] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:52 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:00:52.387742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f4b6-0d2e-4415-aba5-0389093b7829 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.427168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.427997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.428272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.428565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.436609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.438103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:00:52.458123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:52.459142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:00:52.460108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:52.464374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 490/987] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:52.465579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:52.564407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:52.583849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1948dbb-a3bf-4d8c-9ea2-d9eba99c2150 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.623567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.624877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.625373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.625874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.626850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:52.627358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.629176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd9eda-3b37-4cde-bedd-a8f6238da677 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.646533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 498/988] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:52.647816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:52.702213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:52.754569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46824e-efce-4f2a-a3bd-4d31bda93c92 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:52.790838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:52.791508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:52.791818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:52.792093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:52.792951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] RBAC: Adding query filter params (role.id=fdef9ab126e348a4abdef87ac1f7b121, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=cfc40069aff94b77a542e3c02eea4c79) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:52.793258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:52.794703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996783cc-b881-4ec2-b636-850a6dc5b85a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:52.808536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 491/989] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:00:52 2022] GET /identity/v3/role_assignments?user.id=cfc40069aff94b77a542e3c02eea4c79&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=fdef9ab126e348a4abdef87ac1f7b121 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:54.114204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80906-de39-46d1-b7ec-00c27a1f0e50 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.114765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80906-de39-46d1-b7ec-00c27a1f0e50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.114765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80906-de39-46d1-b7ec-00c27a1f0e50 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.116087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 499/990] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:54.121677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc152-5843-4e91-b99a-5cc6590c4950 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.122088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc152-5843-4e91-b99a-5cc6590c4950 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.122182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc152-5843-4e91-b99a-5cc6590c4950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.139708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-856cc152-5843-4e91-b99a-5cc6590c4950 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:54.141235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-856cc152-5843-4e91-b99a-5cc6590c4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:54.209803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 492/991] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:54.232792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80906-de39-46d1-b7ec-00c27a1f0e50 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.335769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80906-de39-46d1-b7ec-00c27a1f0e50 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.340901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428472-60c6-4ee4-abab-f9e22938c9f2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.341189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428472-60c6-4ee4-abab-f9e22938c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.341467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428472-60c6-4ee4-abab-f9e22938c9f2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.343131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 493/992] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:54.347906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.348192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.348472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.365854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:54.366966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:54.373731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.374537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.374806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.375077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.376154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.377559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:54.390522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:54.391755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:54.392630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 500/993] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:54.397595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.409344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.416002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.444364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 494/994] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:00:54.467363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.509747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78f0fc-9d03-4290-a13b-6551afdb3ca1 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.545845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.546636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.546920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.547203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.547900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:54.548256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.549695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.559165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 501/995] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:54.560208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.583002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548fb65-be87-4b49-9ab0-1e0e0dfca3c4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.618018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.618746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.619024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.619298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.619977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.621394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:54.633436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:54.634417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 16:00:54.635263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:54.638577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.638666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 495/996] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:00:54.641121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.672178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa6052-083e-4c50-b404-a046a81db647 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.684025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.707557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.708228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.708534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.708808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.709513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] RBAC: Adding query filter params (type=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:54.709817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.711180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.716589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 502/997] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:54.722043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.748289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632556-8308-4038-9d5c-68f4901de827 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.783357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.784031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.784312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.784616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.785318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:54.785625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.786999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.792132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 496/998] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:54.797602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.827952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021aecd-b0d9-44ca-b894-7f26b9376ece None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.861368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.862035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.862310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.862582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.863373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] RBAC: Adding query filter params (interface=public, service_id=702e097da0364ffe858f5159c6c416bc, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:54.863685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.865094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e3f4-e902-4034-a03d-b84979e7370d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.867354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.873087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 503/999] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/endpoints?service_id=702e097da0364ffe858f5159c6c416bc&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:54.873870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3280-9eff-4d8d-984e-725a6e8e4ef1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.874152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3280-9eff-4d8d-984e-725a6e8e4ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.874427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3280-9eff-4d8d-984e-725a6e8e4ef1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.875702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 504/1000] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:54.876383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb3280-9eff-4d8d-984e-725a6e8e4ef1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:54.902249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5661-abc4-422b-a863-8f2d108dc9c2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:54.903777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:54.936537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:54.937199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.937489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.937756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.938455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:54.938756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:54.940124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b2a4c-89b7-4c19-8c57-7210ebf8ad1e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:54.945219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 497/1001] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:54.946492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:54.946789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:54.947069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:54.964187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:54.965425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:54.975827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb3280-9eff-4d8d-984e-725a6e8e4ef1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:55.007843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:55.008550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:55.008832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:55.009112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:55.009798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:55.011206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:55.017455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 505/1002] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:00:54 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:00:55.018203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:55.038394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 498/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:55.060732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:55.087691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:55.140691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bfa32-a3fb-49ba-b301-eadec42dbf2d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:55.166860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:55.174448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7398a6-b0fc-417e-a51b-748a98a0d893 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:55.179289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:55.179972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:55.180257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:55.181244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:55.181349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:55.182807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:55.203814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 506/1004] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:00:55.224393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:55.225290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:55.225573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:55.225845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] PATH_INFO: `/v3/services/image` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:55.226516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:55.227948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:55.241075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:55.242295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:00:55.243175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 499/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 5 16:00:55 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:55.251326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:55.364822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131acac-3e03-45ef-a2ed-b386a00a96a8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:55.390235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:55.404304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:55.404989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:55.405273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:55.405557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:55.406277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:55.406590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:55.407985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0b781-a3a1-45bf-9311-52fb93c9cd08 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:55.413377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 507/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:55.418996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:55.528772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6721e-da0e-418c-968a-ffe20197d5ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:55.564044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:55.564735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:55.565014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:55.565290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:55.565997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] RBAC: Adding query filter params (type=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:55.566300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:55.567671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c52cb-940c-407b-99ee-45f6cfbe4e53 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:55.580550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 500/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:57.036474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c628-e27c-44b4-90d1-c3ab2700c306 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.037049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c628-e27c-44b4-90d1-c3ab2700c306 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.037049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c628-e27c-44b4-90d1-c3ab2700c306 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.038385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 508/1008] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:57.043894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fca3c-8cf0-4888-a0cd-07d7e7aeb52f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.044340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fca3c-8cf0-4888-a0cd-07d7e7aeb52f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.044435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fca3c-8cf0-4888-a0cd-07d7e7aeb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.061924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7c3fca3c-8cf0-4888-a0cd-07d7e7aeb52f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:57.063107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7c3fca3c-8cf0-4888-a0cd-07d7e7aeb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:57.078609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.134467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 501/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:57.157364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c628-e27c-44b4-90d1-c3ab2700c306 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.229048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b35-710f-43b1-b352-a43f1fc389b8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.229701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b35-710f-43b1-b352-a43f1fc389b8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.230861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b35-710f-43b1-b352-a43f1fc389b8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.233248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 502/1010] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:57.237981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.238545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.239025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.262003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:57.264426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:57.267137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c628-e27c-44b4-90d1-c3ab2700c306 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.303243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.303981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.304259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.304571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.305234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.306612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:00:57.318660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:00:57.319673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:00:57.320788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 509/1011] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:00:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:00:57.325758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.343886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 503/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:57.366565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.382182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.435120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28bcd-2304-41b6-9894-05d8a3ef2191 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.448848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.468368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38250b33-4386-4710-a110-6d2430fccf2d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.483594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.483896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.484195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.484480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.485208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:57.485494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.486950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.492533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 510/1013] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:00:57.498104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.503401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.504204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.504495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.504781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.505970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.507427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.509227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 504/1014] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:57.515248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.603227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b2915-600e-447d-825a-58bbf3917784 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.617370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2aed5-39ed-4fbd-9b4f-b85946007e7c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.618354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.637178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.637823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.638099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.638423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.639096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:00:57.639395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.640817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913d97-20cf-4dff-ba09-1296c40ba1fb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.646086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 511/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 5 16:00:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:00:57.647262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be577f-e127-40b8-b605-1f9f661d3a6f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.647543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be577f-e127-40b8-b605-1f9f661d3a6f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.647817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be577f-e127-40b8-b605-1f9f661d3a6f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.649047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 512/1016] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:57.651691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be577f-e127-40b8-b605-1f9f661d3a6f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.659354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.660033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.660324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.660663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.661380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.662834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb43494-b229-4301-ad10-f502b7e37a1e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.683804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.692269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 505/1017] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:00:57.693798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.694633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.694857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.714245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:57.715487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:57.767749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be577f-e127-40b8-b605-1f9f661d3a6f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.798067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 506/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:57.809088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.809767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.810047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.810322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.811080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.812490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f809d-c406-4ce3-a1fd-19918a2016aa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:57.821624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:57.843907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 513/1019] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:00:57.946968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d55df-cc70-409f-9d05-63ba90b64d82 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:00:57.979886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:57.993866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427c75-9021-42cb-8485-2e188885615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:00:57.994572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427c75-9021-42cb-8485-2e188885615b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:57.994905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427c75-9021-42cb-8485-2e188885615b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:57.995184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427c75-9021-42cb-8485-2e188885615b None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:57.995907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61427c75-9021-42cb-8485-2e188885615b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:00:57.998146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61427c75-9021-42cb-8485-2e188885615b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:00:58.013133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 507/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:00:57 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:00:59.764418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64197e2-de8d-4db2-a39c-7ba05726a714 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:59.765012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64197e2-de8d-4db2-a39c-7ba05726a714 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:59.765012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64197e2-de8d-4db2-a39c-7ba05726a714 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:59.768493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 514/1021] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:00:59.771715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e309-7206-4a96-8f76-bc2ab9c0a353 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:59.772130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e309-7206-4a96-8f76-bc2ab9c0a353 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:59.772311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e309-7206-4a96-8f76-bc2ab9c0a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:59.790168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb12e309-7206-4a96-8f76-bc2ab9c0a353 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:59.791396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb12e309-7206-4a96-8f76-bc2ab9c0a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:00:59.872223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 508/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:00:59.900038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64197e2-de8d-4db2-a39c-7ba05726a714 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:00:59.934336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec982e0-a6a4-49bb-af03-2aa57bbe88ae None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:59.934929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec982e0-a6a4-49bb-af03-2aa57bbe88ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:59.935208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec982e0-a6a4-49bb-af03-2aa57bbe88ae None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:59.936953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 509/1023] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:00:59.940186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:00:59.942812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d5ac-7ac9-4d6e-af1c-f8c984965d12 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:00:59.943326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d5ac-7ac9-4d6e-af1c-f8c984965d12 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:00:59.943802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d5ac-7ac9-4d6e-af1c-f8c984965d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:00:59.964196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4e19d5ac-7ac9-4d6e-af1c-f8c984965d12 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:00:59.966215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4e19d5ac-7ac9-4d6e-af1c-f8c984965d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:00.009670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64197e2-de8d-4db2-a39c-7ba05726a714 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.039304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 510/1024] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:00:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:01:00.046092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d1b31-c8d0-4f38-b0d3-a3e1056fd058 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.046565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d1b31-c8d0-4f38-b0d3-a3e1056fd058 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.046845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d1b31-c8d0-4f38-b0d3-a3e1056fd058 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.047437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.048245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.048357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 511/1025] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:00.051864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.051864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.051864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.051864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.053192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.053306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 515/1026] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:00.053406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.053645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.059120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.071149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:00.072327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:00.106787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.137324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 512/1027] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:00.138142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.162482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62408456-ca5a-43e3-998c-79c412c289d6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.164789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.196167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.196871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.197155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.197427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.198160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.199607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.222404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 516/1028] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:01:00 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:01:00.223276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.253667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbafdf4-acce-472d-aa8e-6192b72c573f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.291020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.292293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.292621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.292968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.304437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:00.312963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:00.314014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:00.314911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 513/1029] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:00.320484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.354862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.357398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45123-6c50-4343-98ce-b255a0d9fa09 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.398494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.399807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.400094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.400372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] PATH_INFO: `/v3/services/image` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.401126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.402961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:00.414733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:00.415766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:00.416757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 517/1030] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:00.422430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.442772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb4f1-bb11-4511-863b-648178f81dfe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.454953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.480570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.481263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.481604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.481886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.482659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:00.482968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.484617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.498052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 514/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:00.499202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.541436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4d6d-bfe1-487a-a9b9-d624d21fb86d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.575423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.576099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.576385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.576729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.577434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:00.577764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.579157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.584544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 518/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:00.590306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.608092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.616635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a808b1-90a8-4782-943e-b0239afb698c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.654084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.654926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.655208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.655509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.666739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.668189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.682688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:00.685265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:00.686330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:00.687330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:00.687330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:00.687330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:00.687330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:00.687330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 515/1033] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:01:00.692070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.701271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab811013-2737-4dc8-b8af-fdf4beaed5a2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.735816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.736522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.736807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.737138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.737852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:00.738212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.739604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.744801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 519/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:00.750452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.804895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d574a5-fc7d-4c22-a631-e47960b78e88 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.841054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.841730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.842013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.842298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.843129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:00.843440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.844872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.854775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569532-cb1f-4e9d-bac9-1d68470008e8 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:00.868802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 516/1035] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:00.868802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.877775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.898328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:00.899131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:00.899422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:00.899698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:00.900517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] RBAC: Adding query filter params (interface=public, service_id=738a2dd8e60a43b79abd7c36e29cea0f, region_id=RegionOne) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:00.900889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:00.903393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:00.915940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 520/1036] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/endpoints?service_id=738a2dd8e60a43b79abd7c36e29cea0f&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:00.917212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:00.936409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:00.974394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4ff9-d8f0-4760-ac5e-66c9e828b945 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.015202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.016016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.016308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.016604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.023462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58a7e-8738-495d-ab26-e9f95adef460 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.024043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.025549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:01:01.040072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:01.041116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:01.042068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 517/1037] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:01.048666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:01.064175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.064826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.065115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.065394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.066087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.067476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.084500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 521/1038] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:01:00 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:01:01.132544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:01.174991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7978c-386e-43c3-9005-96e93c053bb8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.220272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.221004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.222672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.222672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.222672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:01.222909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.224521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.243409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 518/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:01:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:01.249488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:01.332309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:01.352735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f745-d4f3-48ab-888f-e3d713c0d29c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.388202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.388906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.389183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.389451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.460462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.461933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.548234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:01.570109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 522/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:01.575777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:01.678370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fdfa6-6a01-49be-a66e-60781e27dfe6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.702291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:01.715229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.716061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.716320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.716644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.727290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.728862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:01.746950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:01.747884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:01.749209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:01.749209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:01.749209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:01.749209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:01.749749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 519/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:01.754047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:01.857204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e7e39-b1f0-44fd-bbef-8c5c3128c25a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:01.892620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:01.893592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:01.894078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:01.894535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:01.895424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:01.895902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:01.897478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:01.913737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 523/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:01.915006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.018438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342294-4493-42e6-973e-87be50706d9a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.053510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.054374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.054640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.054940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.061926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:02.063398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:01:02.077466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:02.078373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:02.079261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:02.080650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 520/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:02.084936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.129110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:02.193054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693144dc-a02d-43ce-b385-02a3f017822d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.229108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.229781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.230068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.230325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.231165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:02.231477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:02.232939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05b936-4852-4c72-a560-687c8d9934ec None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:02.245525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 524/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:02.251383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.288860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:02.305405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8e81-1bee-4f74-8c4b-ecb454290f68 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.305687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8e81-1bee-4f74-8c4b-ecb454290f68 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.305972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8e81-1bee-4f74-8c4b-ecb454290f68 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.307620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 525/1045] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:01:02.312304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.312618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.312891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.329280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:02.330455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:02.361348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb04f1-30ae-4eaa-84a5-8f620c9503f1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.397410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.398092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.398372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.398646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.399466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] RBAC: Adding query filter params (role.id=fdef9ab126e348a4abdef87ac1f7b121, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:02.399773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:02.401383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:02.402013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 526/1046] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:01:02.407137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 521/1047] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=fdef9ab126e348a4abdef87ac1f7b121 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:02.430127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.464577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:02.542588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e223f-7d56-4ecd-9d74-1dcb4cff9476 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.582148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.582961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.583235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.583514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.594267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:02.601830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:02.602758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:02.603620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 527/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:02.609073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.712181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:02.715717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b10e2-1cdf-40b6-ac4b-e255765547a9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.751393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.752077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.752362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.752668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.753434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:02.753909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:02.755309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:02.764500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 522/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:02.770092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:02.862208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:02.872613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a19f2-5604-44cc-814d-f7dd3f781065 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:02.905819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:02.906709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:02.906950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:02.907215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] PATH_INFO: `/v3/users/253a1230a0d74f18ab2641b6c5400442` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:02.920792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] RBAC: Authorizing `identity:get_user(user_id=253a1230a0d74f18ab2641b6c5400442)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:02.922263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8995-a667-4e68-a0ee-8e264ab92547 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:02.924158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 528/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/users/253a1230a0d74f18ab2641b6c5400442 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:02.929810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.029519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc47976-43fa-4cb2-ab04-97a077abcacb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.063177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.063829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.064115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.064389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.071459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53192f-2f41-4a83-8310-675345ad0edc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.071753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53192f-2f41-4a83-8310-675345ad0edc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.072031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53192f-2f41-4a83-8310-675345ad0edc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.076837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 529/1051] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:01:03.078458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.078765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.079040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.096852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:03.097955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:03.098098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:03.137982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.139343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.164510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 530/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:03.186531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.240704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 523/1053] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:02 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:03.246738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.273628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:03.296578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d139bc-1643-48f0-bc98-5a84f0502d8b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.310057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:03.330994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.332106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.332385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.332713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] PATH_INFO: `/v3/services/image` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.333361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.334728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:03.346663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:03.347662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:03.348613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 531/1054] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 5 16:01:03 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:01:03.352963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135cf77-92c0-4d90-871f-b052765433c7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.353858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.389150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.389941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.390223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.390496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.391688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.393171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.395039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 524/1055] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:03 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:03.400990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.452336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667f54-6fb9-42c4-b844-637c5858d845 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.493919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.494742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.495124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.495948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.496833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] RBAC: Adding query filter params (name=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:03.497245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.498807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.509432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 532/1056] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:03.510789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.514510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c29d4-b2c7-4056-9fc6-460095483494 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.520620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:03.544807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:03.551944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.553173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.553607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.553985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.555266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=860ce0647ac348ab9ea452ac080288b0, user.id=253a1230a0d74f18ab2641b6c5400442) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:03.555984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.557661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.570720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 525/1057] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:03 2022] GET /identity/v3/role_assignments?user.id=253a1230a0d74f18ab2641b6c5400442&scope.project.id=860ce0647ac348ab9ea452ac080288b0&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:03.617409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be87ef-9dcc-4e04-9479-30831f496e6d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.656770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.657381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.657664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.657942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.658671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] RBAC: Adding query filter params (type=image) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:03.658982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.660403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcdd6e-b384-4eea-a10b-d823365902fe None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.671280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 533/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:03.672264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:03.780972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53754e8f-934a-4a77-81aa-bac79854b435 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:03.814402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:03.815071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:03.815358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:03.815645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:03.816390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:03.817868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b544ea-000d-4c4a-a7e0-704782f9eef8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:03.844488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 526/1059] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:01:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:01:04.412300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953940-4ddb-45ed-844f-dae5565c19ad None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:04.412867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953940-4ddb-45ed-844f-dae5565c19ad None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:04.412867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953940-4ddb-45ed-844f-dae5565c19ad None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:04.414306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 534/1060] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:04.419751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135da10-d781-45ab-b257-1607263c873a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:04.420169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135da10-d781-45ab-b257-1607263c873a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:04.420245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135da10-d781-45ab-b257-1607263c873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:04.437096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7135da10-d781-45ab-b257-1607263c873a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:04.438266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7135da10-d781-45ab-b257-1607263c873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:04.488917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:04.516311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 527/1061] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:04.538681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae953940-4ddb-45ed-844f-dae5565c19ad None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:04.608979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:04.641903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae953940-4ddb-45ed-844f-dae5565c19ad None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:04.678708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:04.679458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:04.679737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:04.680008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:04.691936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:04.700285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:04.701364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:04.702220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 535/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:01:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:04.708132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135da10-d781-45ab-b257-1607263c873a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:04.810748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135da10-d781-45ab-b257-1607263c873a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:04.845089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:04.845764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:04.846045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:04.846321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:04.847070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:04.847374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:04.848792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:04.857075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 528/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:01:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:04.862635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:04.963161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3885d-1fd1-44e3-8723-eb8a3aec2797 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:04.994199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.001059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.001871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.002143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.002409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.013207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.014675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:05.033125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:05.034038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:05.034945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:05.034945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:05.034945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:05.034945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:05.036819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 536/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:05.040328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.083379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.146449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761d400-b7ad-4699-a494-af92342452a2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.181959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.182635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.182917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.183190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.183917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:05.184205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.185641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.197273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 529/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:05.203403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.308501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa2eb-8a25-49b9-8283-7e4e11d55e2c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.343002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.343806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.344083 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.344349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.351625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.353123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:01:05.367304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:05.368273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:05.374679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 537/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:05.375291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.478196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.487936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd962b-f9ff-455f-af55-0a69c409172b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.523548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.524218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.524532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.524811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.525702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:05.526011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.527439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227de4-2029-47f5-ab60-f872a9c8450c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.545459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 530/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:05.550953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.595114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9995-c036-45dd-a6ce-69069dcbd90f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.595659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9995-c036-45dd-a6ce-69069dcbd90f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.595941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9995-c036-45dd-a6ce-69069dcbd90f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.596370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.597416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 531/1068] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:05.602698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.602984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.603261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.620173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:05.621404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:05.665103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a6f6-5506-4d0b-9de9-4de503bfe07a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.694397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 532/1069] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:01:05.701991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.702801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.703078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.703351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.714176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.715666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.716955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:05.735664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:05.736658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:05.737543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:05.737543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:05.737543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:05.737543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:05.737543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 538/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:05.742376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.807851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.825788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1233-02b9-471a-99e4-f1332a6cc459 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.841527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:05.848421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108310d-b674-47d2-bb25-70244ed8fd20 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:05.865572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.866380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.866662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.866937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.877007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:05.881052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:05.881715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.881992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.882260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.882978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:05.883278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-becf3122-74c0-4693-a775-14ad1fdf7905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:05.884478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:05.885509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:05.886350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:05.886986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d95af2-7eef-405b-9400-ad50c1fe8b2e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:05.887063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 533/1071] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:05.887063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4665e-d2c9-45bc-a86b-50da7cce6e2f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.887282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4665e-d2c9-45bc-a86b-50da7cce6e2f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.887768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4665e-d2c9-45bc-a86b-50da7cce6e2f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.888777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 534/1072] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:05.891813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4665e-d2c9-45bc-a86b-50da7cce6e2f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.900578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 539/1073] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:05.901702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:05.901990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:05.902268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:05.918146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:05.919339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:05.983461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 540/1074] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:05.984262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:05.997186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4665e-d2c9-45bc-a86b-50da7cce6e2f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.031570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.032221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.032541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.032815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.033571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:06.033882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.035261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.043328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 535/1075] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:06.044107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.054883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.063577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.079868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1bf3-481c-426b-bf9c-cd1056bbd5e8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.114807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.115533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.115811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.116080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.122835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.124277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:01:06.137935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:06.139017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 541/1076] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:06.140044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.144425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31049-13ee-49a2-9e7c-9307b6527ebf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.176223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.176923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.177201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.177475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.236866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bada-f204-41f9-8ce7-7effcebc1302 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.244485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.246130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.256070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.270602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.271726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.272002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.272273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] PATH_INFO: `/v3/users/253a1230a0d74f18ab2641b6c5400442` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.273511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] RBAC: Authorizing `identity:get_user(user_id=253a1230a0d74f18ab2641b6c5400442)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.274959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.276763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 542/1077] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/users/253a1230a0d74f18ab2641b6c5400442 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:06.277505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.291422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.348199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 536/1078] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:06.349272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.374976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18854b-e963-4e3f-b996-92dfa359fcfa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.407974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.408665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.408918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.409190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.409977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:06.410282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.411730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.423803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 543/1079] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:06.424620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.451203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1634c-1e08-4045-820c-d998490dee91 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.460497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.492109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.493154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.493297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.493580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.494483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.494805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.496344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.498165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 537/1080] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:06.498928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.527996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8bf8-b35e-40c1-9dbb-6155e96848e0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.562477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.563750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.564131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.564408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.575295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.576775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:06.594285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:06.595221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:06.596113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:06.596113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:06.596113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:06.596113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:06.596113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 544/1081] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:06.596393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.606274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7496-d94e-4435-b8f1-3427a4cf221f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.642071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.642905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.643181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.643450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/fdef9ab126e348a4abdef87ac1f7b121` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.645934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=9bb2c2c6299946e1a172eb6948b28094, role_id=fdef9ab126e348a4abdef87ac1f7b121)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.647388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.661090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 538/1082] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:01:06 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/9bb2c2c6299946e1a172eb6948b28094/roles/fdef9ab126e348a4abdef87ac1f7b121 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:01:06.661884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:06.701183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4ff27-1206-485a-abde-472db26d7e39 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.702939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.730314 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:06.746222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.749544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.749544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.749544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0/users/253a1230a0d74f18ab2641b6c5400442/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.750860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=860ce0647ac348ab9ea452ac080288b0, user_id=253a1230a0d74f18ab2641b6c5400442, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.753280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d979f2e-b11e-453f-bcd1-b7071dbb87d1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.770477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 545/1083] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:01:06 2022] PUT /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0/users/253a1230a0d74f18ab2641b6c5400442/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:01:06.804607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c10d3-a21d-4e3e-9437-182f3a7f1aa8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:06.849790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:06.850993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:06.851298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:06.851573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:06.852323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:06.852755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:06.854403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935733-5315-472b-9e90-6e3250292e56 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:06.872481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 539/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:08.656691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28c64-8d14-44ee-9244-098b1f7668d3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:08.657243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28c64-8d14-44ee-9244-098b1f7668d3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:08.657243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28c64-8d14-44ee-9244-098b1f7668d3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:08.658616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 546/1085] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:08.663818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200edf1-db88-449d-933f-92f99c69564e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:08.664253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200edf1-db88-449d-933f-92f99c69564e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:08.664463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200edf1-db88-449d-933f-92f99c69564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:08.682180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a200edf1-db88-449d-933f-92f99c69564e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:08.683365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a200edf1-db88-449d-933f-92f99c69564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:08.753231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 540/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:08.776351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f28c64-8d14-44ee-9244-098b1f7668d3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:08.787673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf47f-79ee-47d4-8ad3-721ba83c22c8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:08.787986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf47f-79ee-47d4-8ad3-721ba83c22c8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:08.788241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf47f-79ee-47d4-8ad3-721ba83c22c8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:08.789645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 541/1087] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:08.794799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:08.795085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:08.795367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:08.813048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:08.814225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:08.835120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:08.879248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f28c64-8d14-44ee-9244-098b1f7668d3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:08.884609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 542/1088] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:08.908325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:08.912994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:08.913820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:08.914097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:08.914368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:08.924930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:08.933149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:08.934093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:08.934935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 547/1089] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 5 16:01:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:08.940178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:08.984156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.011179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca99895-94db-4f78-8084-4b5548aa8109 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.038099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456b8-3aa7-40a7-be6b-7785d1fd8a21 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.043709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.044566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.044853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.045127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.054976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:09.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:09.063765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:09.064648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 543/1090] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:01:09.069967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.070399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.071075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.071354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.071628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.072420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:09.072754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.074136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.082539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 548/1091] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:01:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.088053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.088843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.169993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141861b-9f21-432f-98e6-bb3177541f65 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.187726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17233-5aaa-41de-a721-deb4ff2e72ee None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.194420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.203077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.203752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.204033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.204308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.205095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:09.205402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.207172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.216037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 544/1092] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.221759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.228533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.229372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.229675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.229935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.241608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.243056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:09.260710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:09.261834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:09.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:09.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:09.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:09.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:09.262939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 549/1093] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:01:09.267564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.301595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.323602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d62c-600c-4ccd-8cd7-9d67611cf648 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.356408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.357321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.357605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.357928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] PATH_INFO: `/v3/users/253a1230a0d74f18ab2641b6c5400442` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.359124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=253a1230a0d74f18ab2641b6c5400442)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.360720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.362352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 545/1094] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/users/253a1230a0d74f18ab2641b6c5400442 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.368008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.369409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db03-0a82-4984-a733-aa7aa7a8f633 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.402444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.403095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.403372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.403645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.404356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:09.404696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.406041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.417431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 550/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.423102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.440516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.465788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ecef-b8b3-414a-9f69-c71e1690b4c8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.506193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.506854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.507129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.507477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.522605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.522732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531514-097b-46c0-b389-e950c8b05441 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.556743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.557548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.557828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.558099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.565162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.566629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.573137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.574586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:01:09.582647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:09.583592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:09.584728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 551/1096] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:01:09.589871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.666581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.675028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 546/1097] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 16:01:09.681006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.688818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cad1c-48c4-4335-8845-2d0e37e1c9e3 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.722372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.723037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.723310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.723579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.724412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:09.724739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.726170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.727567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.743236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 552/1098] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.748970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.780716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2307b-abab-4e3f-898d-4fac14d30876 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.814074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.814943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.815229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.815502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.816731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.818176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.819884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 547/1099] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:09.825996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:09.843688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e6666-70e2-4ef7-9e91-690a87e7dab7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.877929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.878572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.878852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.879116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.882510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.923031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4304f1-55bc-462e-a1dc-6d0997987558 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:09.937853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:09.945589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.947052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.960010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:09.960691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:09.960971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:09.961240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:09.962057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=860ce0647ac348ab9ea452ac080288b0, user.id=253a1230a0d74f18ab2641b6c5400442) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:09.962363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:09.963824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:09.969780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 548/1100] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/role_assignments?user.id=253a1230a0d74f18ab2641b6c5400442&scope.project.id=860ce0647ac348ab9ea452ac080288b0&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:10.053199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 553/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 16:01:10.059288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:10.165654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7763a-423a-4e42-8412-ffa736450750 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:10.199569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:10.200365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:10.200670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:10.200945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:10.212020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:10.213493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:10.231156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:10.232132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:10.233529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:01:10.233529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:10.233529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:01:10.233529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:10.233529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 549/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:10.238198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:10.278175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:10.354757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3d705-5665-40c7-9723-c93d735536c5 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:10.394722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:10.395387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:10.395690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:10.395966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:10.396717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:10.397020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:10.398392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:10.410020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 554/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:10.415783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:10.449780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:10.528011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70563-40e1-4f0c-8e77-c5d15b39d066 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:10.562123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:10.562916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:10.563196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:10.563465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:10.570477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:10.571937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:01:10.586539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:10.587479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:10.588889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 550/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:10.594468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:10.693765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:10.700696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee06a-2f2c-443d-908b-7379edf26caf None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:10.735154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:10.735810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:10.736087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:10.736360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:10.737169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:10.737473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:10.738901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a75cb1-c416-444b-905d-e55140baab2c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:10.751005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 555/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:10.757179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:10.845331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:10.855059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba62f-43e9-464d-aec0-115b55b0b5ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:10.891554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:10.892647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:10.893118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:10.893593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:10.895096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] RBAC: Adding query filter params (role.id=fdef9ab126e348a4abdef87ac1f7b121, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=9bb2c2c6299946e1a172eb6948b28094) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:10.895626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:10.898057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eeb11-d6dd-4071-83e3-11a561957dda None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:10.904552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 551/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:10 2022] GET /identity/v3/role_assignments?user.id=9bb2c2c6299946e1a172eb6948b28094&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=fdef9ab126e348a4abdef87ac1f7b121 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:11.995883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8485-013f-4e4e-8e27-94875149b52d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:11.996436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8485-013f-4e4e-8e27-94875149b52d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:11.996436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd8485-013f-4e4e-8e27-94875149b52d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:11.998569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 556/1107] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:12.006415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:12.006856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:12.006946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:12.025198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:12.026396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:12.094931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 552/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:01:12.119120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd8485-013f-4e4e-8e27-94875149b52d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:12.243801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd8485-013f-4e4e-8e27-94875149b52d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:12.279076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:12.279805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:12.280086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:12.280360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:12.281603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:12.283041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37dde1-1875-4353-bd2b-5805a20f4470 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:12.284689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 557/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:12.291248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:12.387320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:12.414880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6e5db-8aa6-408a-a9d4-8c0b987b9a3f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:12.453614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:12.454274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:12.454554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:12.454829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:12.455539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:12.457497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221b88-f3ab-4194-a607-5c9452f11549 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:12.482041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 553/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:01:12 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:14.537160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702f0c7-93e1-4d24-8abe-3ebc651887f7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:14.537695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702f0c7-93e1-4d24-8abe-3ebc651887f7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:14.537695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702f0c7-93e1-4d24-8abe-3ebc651887f7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:14.539128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 558/1111] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:14.545796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:14.546484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:14.546663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:14.569427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:14.570634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:14.653899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 554/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:14.682573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702f0c7-93e1-4d24-8abe-3ebc651887f7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:14.713824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:14.793191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702f0c7-93e1-4d24-8abe-3ebc651887f7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:14.828182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:14.829071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:14.829356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:14.829636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] PATH_INFO: `/v3/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:14.831519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] RBAC: Authorizing `identity:get_role(role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:14.832946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:14.834334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 559/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:14 2022] GET /identity/v3/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:14.840999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:14.922755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:14.956763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99d71-4733-4a0b-b302-60734b6c7d8b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:14.991643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:14.992545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:14.992834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:14.993108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] PATH_INFO: `/v3/users/259f6fbdddb84925b00d69fb7f90409d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:15.006519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=259f6fbdddb84925b00d69fb7f90409d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:15.007974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:15.009722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 555/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:14 2022] GET /identity/v3/users/259f6fbdddb84925b00d69fb7f90409d => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:15.018626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:15.114321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:15.125022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b94ea-1acf-46b1-b8c2-fa426a5b7743 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:15.162738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:15.163380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:15.163668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:15.163945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:15.242759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:15.244785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:15.334437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:15.344337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 560/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 16:01:15.350611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:15.475459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574df2e-ad55-4581-ab66-41052e69d1d2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:15.513686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:15.522935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:15.523806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:15.524086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:15.524358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:15.525722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:15.527184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53c69b-5c2f-4a84-9052-12f189036375 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:15.528938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 556/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:15 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:15.535351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:15.633896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd909df-51fb-436a-8dca-2add02549351 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:15.674826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:15.675488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:15.675770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:15.676050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:15.676887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=860ce0647ac348ab9ea452ac080288b0, user.id=259f6fbdddb84925b00d69fb7f90409d) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:15.677229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:15.678675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81aca5-c367-4914-957b-2be6c3e809df None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:15.684228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 561/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:15 2022] GET /identity/v3/role_assignments?user.id=259f6fbdddb84925b00d69fb7f90409d&scope.project.id=860ce0647ac348ab9ea452ac080288b0&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:17.671245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad821-ceee-4853-9c44-0ee9cb9c14bd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:17.671828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad821-ceee-4853-9c44-0ee9cb9c14bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:17.671828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad821-ceee-4853-9c44-0ee9cb9c14bd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:17.673229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 557/1118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:17.679709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:17.680145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:17.680330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:17.704456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:17.705675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:17.757885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:17.775966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 562/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:17.804833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdad821-ceee-4853-9c44-0ee9cb9c14bd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:17.917514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdad821-ceee-4853-9c44-0ee9cb9c14bd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:17.952585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:17.953442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:17.953708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:17.954000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] PATH_INFO: `/v3/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:17.955601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] RBAC: Authorizing `identity:get_role(role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:17.957389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:17.958757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 558/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:17 2022] GET /identity/v3/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:17.965775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:18.077637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f415a-9edf-44e4-8fd6-b8cac7accd22 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:18.113386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:18.114262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:18.114544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:18.114820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] PATH_INFO: `/v3/users/259f6fbdddb84925b00d69fb7f90409d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:18.116116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] RBAC: Authorizing `identity:get_user(user_id=259f6fbdddb84925b00d69fb7f90409d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:18.117670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:18.119352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 563/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:17 2022] GET /identity/v3/users/259f6fbdddb84925b00d69fb7f90409d => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:18.125731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:18.193445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:18.234527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452ac0-0f9c-4d02-86ee-19b2ab2d2ed1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:18.270224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:18.271089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:18.271373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:18.271654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:18.272994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:18.274432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519f7ee-577b-47b4-b05f-823b1050f061 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:18.276213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 559/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:18 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:18.282420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:18.338501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:18.395975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63e632-ce78-4adf-9d1e-47f4a5a63c3c None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:18.431528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:18.432413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:18.432723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:18.432995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0/users/259f6fbdddb84925b00d69fb7f90409d/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:18.435593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] RBAC: Authorizing `identity:create_grant(project_id=860ce0647ac348ab9ea452ac080288b0, user_id=259f6fbdddb84925b00d69fb7f90409d, role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:18.437065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cb35f-4534-4e2f-9211-17755591f93d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:18.453799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 564/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:01:18 2022] PUT /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0/users/259f6fbdddb84925b00d69fb7f90409d/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:01:20.408196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa305-23b3-4228-9484-301c8b4873d7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:20.408859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa305-23b3-4228-9484-301c8b4873d7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:20.408859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa305-23b3-4228-9484-301c8b4873d7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:20.410179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 560/1124] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:20.416496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c572-4636-493a-9109-55a301090974 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:20.417251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c572-4636-493a-9109-55a301090974 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:20.417396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c572-4636-493a-9109-55a301090974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:20.441316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a357c572-4636-493a-9109-55a301090974 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:20.442511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a357c572-4636-493a-9109-55a301090974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:20.513354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 565/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:20.545156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa305-23b3-4228-9484-301c8b4873d7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:20.657020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa305-23b3-4228-9484-301c8b4873d7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:20.686593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:20.692281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818823-a795-467c-b706-9047a216f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:20.693174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818823-a795-467c-b706-9047a216f72b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:20.693454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818823-a795-467c-b706-9047a216f72b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:20.693709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818823-a795-467c-b706-9047a216f72b None admin] PATH_INFO: `/v3/roles/e8dbffb4134b4718acabc4d4407cc354` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:20.695311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818823-a795-467c-b706-9047a216f72b None admin] RBAC: Authorizing `identity:get_role(role_id=e8dbffb4134b4718acabc4d4407cc354)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:20.696718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818823-a795-467c-b706-9047a216f72b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:20.698160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 561/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:20 2022] GET /identity/v3/roles/e8dbffb4134b4718acabc4d4407cc354 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:20.705962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c572-4636-493a-9109-55a301090974 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:20.751238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:20.806757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c572-4636-493a-9109-55a301090974 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:20.842690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:20.843571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:20.843852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:20.844129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] PATH_INFO: `/v3/users/259f6fbdddb84925b00d69fb7f90409d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:20.845464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] RBAC: Authorizing `identity:get_user(user_id=259f6fbdddb84925b00d69fb7f90409d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:20.846914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:20.848587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 566/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:20 2022] GET /identity/v3/users/259f6fbdddb84925b00d69fb7f90409d => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:20.856830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818823-a795-467c-b706-9047a216f72b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:20.965304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818823-a795-467c-b706-9047a216f72b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:21.000283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:21.000960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:21.001246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:21.001524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:21.068252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:21.070806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:21.072306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:21.173017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 562/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:21.182486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:21.294858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511405bf-dc3a-4a69-853f-4525ac6f40fa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:21.308699 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:21.343010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:21.343878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:21.344154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:21.344424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] PATH_INFO: `/v3/projects/860ce0647ac348ab9ea452ac080288b0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:21.345757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] RBAC: Authorizing `identity:get_project(project_id=860ce0647ac348ab9ea452ac080288b0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:21.347199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54430a95-d4f3-41a5-abdd-ddf0e902bf9c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:21.348955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 567/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:21 2022] GET /identity/v3/projects/860ce0647ac348ab9ea452ac080288b0 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:21.355317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:21.454001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:21.457453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6f1c4-9160-418c-a55a-d1c53afb8b90 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:21.494704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:21.495378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:21.495657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:21.495924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:21.496794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] RBAC: Adding query filter params (role.id=e8dbffb4134b4718acabc4d4407cc354, scope.project.id=860ce0647ac348ab9ea452ac080288b0, user.id=259f6fbdddb84925b00d69fb7f90409d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:21.497097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:21.498529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7825-4045-4b34-85b0-e39617b2ea19 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:21.504375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 563/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:21 2022] GET /identity/v3/role_assignments?user.id=259f6fbdddb84925b00d69fb7f90409d&scope.project.id=860ce0647ac348ab9ea452ac080288b0&role.id=e8dbffb4134b4718acabc4d4407cc354 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:23.508549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de98c5-4bd2-4ecd-b049-353d4bc87258 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:23.509059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de98c5-4bd2-4ecd-b049-353d4bc87258 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:23.509059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de98c5-4bd2-4ecd-b049-353d4bc87258 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:23.510474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 568/1131] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:23.515783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:23.516204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:23.516314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:23.534495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:23.535654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:23.607133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 564/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:23.630703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de98c5-4bd2-4ecd-b049-353d4bc87258 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:23.743610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de98c5-4bd2-4ecd-b049-353d4bc87258 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:23.779347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:23.780117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:23.780387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:23.780685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:23.781900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:23.783339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66d4f7-140a-4676-adc7-9c82296cdaea None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:23.784985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 569/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:23.793729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:23.890606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:23.901958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b207970-932d-40f8-aa21-a42ac8c8354a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:23.941352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:23.942005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:23.942284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:23.942555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:23.943247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:23.944716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc112a-74c7-4a58-a21c-ad7fdcdfd29e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:23.974044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 565/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:01:23 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:25.998681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9103-36b1-4d83-958d-288b79ef0c02 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:25.999539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9103-36b1-4d83-958d-288b79ef0c02 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:25.999539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9103-36b1-4d83-958d-288b79ef0c02 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:26.001837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 570/1135] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:26.008328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:26.009065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:26.009216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:26.028941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:26.030124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:26.100647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 566/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:26.126863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9103-36b1-4d83-958d-288b79ef0c02 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:26.179981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:26.234817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9103-36b1-4d83-958d-288b79ef0c02 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:26.269590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:26.270315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:26.270595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:26.270869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:26.272080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:26.273547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58080bf6-1503-47f4-9621-11089a5e659d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:26.275188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 571/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:26.281789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:26.370462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:26.394898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6b9f-a825-4ce3-9506-a610b095f89a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:26.429761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:26.430417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:26.430650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:26.430960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:26.431685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:26.433208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d14fed-75d8-4009-beba-65d5d9b3f4b8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:26.461771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 567/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:01:26 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:28.475988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789439d-e581-4c14-bdf8-3b8a8e4cafc0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:28.476894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789439d-e581-4c14-bdf8-3b8a8e4cafc0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:28.477008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789439d-e581-4c14-bdf8-3b8a8e4cafc0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:28.479241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 572/1139] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:28.484517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:28.484934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:28.485075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:28.502904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:28.504073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:28.571784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 568/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:28.595805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789439d-e581-4c14-bdf8-3b8a8e4cafc0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:28.699128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789439d-e581-4c14-bdf8-3b8a8e4cafc0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:28.717485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:28.745884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:28.746679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:28.746963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:28.747236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:28.758480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:28.766127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:28.767266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:28.768581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 573/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:28.773628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:28.834228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:28.876527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416c10-8870-46da-b846-46bd901ae2ef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:28.915657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:28.916475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:28.916766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:28.917044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:28.917802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:28.918111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:28.919506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:28.928142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 569/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:28.934111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:29.032021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e85ce-88b6-4db1-ab4b-957484dad35f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:29.064940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:29.065832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:29.066112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:29.066385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] PATH_INFO: `/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:29.079140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] RBAC: Authorizing `identity:get_user(user_id=bf192ebff0c54a04992a1b9a25fdb3b7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:29.080661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:29.082695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 574/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:28 2022] GET /identity/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:29.088709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:29.203160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0f52f-a536-43b4-934a-9e0b78f2c558 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:29.232925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:29.245245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:29.245895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:29.246177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:29.246453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:29.314230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:29.315615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:29.424101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 570/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:29.430474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:29.468766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:29.540800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5222-8138-466b-8333-63fb646cd01f None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:29.575892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:29.576733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:29.577013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:29.577291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] PATH_INFO: `/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:29.578618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd8d5599edca41de9fa4f2d40bb1d70a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:29.580082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10145c25-4392-4555-9562-d551ed0821e6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:29.582205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 575/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:29 2022] GET /identity/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:29.589322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:29.619872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:29.706636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5232-ac9c-4309-838e-cef699f287bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:29.741750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:29.742402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:29.742681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:29.742954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:29.743776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=bd8d5599edca41de9fa4f2d40bb1d70a, user.id=bf192ebff0c54a04992a1b9a25fdb3b7) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:29.744082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:29.745574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6f4eb-6a74-4bc1-9f90-386009e8f981 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:29.751060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 571/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:29 2022] GET /identity/v3/role_assignments?user.id=bf192ebff0c54a04992a1b9a25fdb3b7&scope.project.id=bd8d5599edca41de9fa4f2d40bb1d70a&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:31.723678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f1840-70c8-448c-a2e4-bd68fbee1d12 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:31.724263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f1840-70c8-448c-a2e4-bd68fbee1d12 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:31.724263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f1840-70c8-448c-a2e4-bd68fbee1d12 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:31.725657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 576/1147] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:31.732268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:31.733068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:31.733287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:31.755576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:31.756810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:31.829449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 572/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:31.858170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f1840-70c8-448c-a2e4-bd68fbee1d12 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:31.964127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f1840-70c8-448c-a2e4-bd68fbee1d12 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:31.965717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:32.000683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:32.001472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:32.001750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:32.002023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:32.012818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:32.020293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:32.021377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:32.022413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 577/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:32.029944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:32.051019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:32.139463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf605f-f025-4269-8df8-f86fb27a0b36 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:32.175304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:32.175965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:32.176244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:32.176547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:32.177297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:32.177603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:32.179008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:32.187152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 573/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:32.196697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:32.300864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c5e5-6a8a-4a3d-8617-d931e28db748 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:32.335722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:32.336617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:32.336897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:32.337174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] PATH_INFO: `/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:32.338535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] RBAC: Authorizing `identity:get_user(user_id=bf192ebff0c54a04992a1b9a25fdb3b7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:32.339980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:32.341650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 578/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:32 2022] GET /identity/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:32.347841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:32.446955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:32.468724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9167dd-4618-440e-a0e3-361b0e0d8a1d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:32.505311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:32.506194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:32.506476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:32.506751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] PATH_INFO: `/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:32.507964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] RBAC: Authorizing `identity:get_project(project_id=bd8d5599edca41de9fa4f2d40bb1d70a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:32.509456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bfd2-4af8-4d86-96d5-2c6d80b355d9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:32.511197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 574/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:32 2022] GET /identity/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:32.517761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:32.552128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:32.642554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca9c9b-960d-4b29-ba9b-86d7bd64ff42 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:32.679262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:32.680143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:32.680422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:32.680728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] PATH_INFO: `/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a/users/bf192ebff0c54a04992a1b9a25fdb3b7/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:32.682909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd8d5599edca41de9fa4f2d40bb1d70a, user_id=bf192ebff0c54a04992a1b9a25fdb3b7, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:32.684344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ee74-346b-425e-9f40-ffdcd8d4a408 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:32.699477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 579/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:01:32 2022] PUT /identity/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a/users/bf192ebff0c54a04992a1b9a25fdb3b7/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:01:34.668839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052961c-3626-4e20-a0fa-2746f573ac36 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:34.669394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052961c-3626-4e20-a0fa-2746f573ac36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:34.669394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052961c-3626-4e20-a0fa-2746f573ac36 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:34.670764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 575/1154] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:34.677077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:34.677814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:34.677963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:34.698763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:34.699943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:34.772503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 580/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:34.796141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052961c-3626-4e20-a0fa-2746f573ac36 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:34.916060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052961c-3626-4e20-a0fa-2746f573ac36 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:34.952825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:34.953624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:34.953906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:34.954181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:34.965266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:34.972909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:34.973970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:34.975036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 576/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:34.981487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:35.004390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:35.085251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f230-8d8a-4c0c-acce-25e99e13e793 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:35.121202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:35.121935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:35.122214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:35.122488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:35.123227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:35.123535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:35.124943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:35.133762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 581/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:35.139778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:35.151344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:35.253771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34893ae5-2a5e-4fd8-b45e-71d8fd8a2da0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:35.294988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:35.295863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:35.296146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:35.296419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] PATH_INFO: `/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:35.297691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] RBAC: Authorizing `identity:get_user(user_id=bf192ebff0c54a04992a1b9a25fdb3b7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:35.299210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:35.300899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 577/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:35 2022] GET /identity/v3/users/bf192ebff0c54a04992a1b9a25fdb3b7 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:35.307304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:35.394899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:35.413251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f140-cc9c-489c-ab6d-68e033ba2572 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:35.447332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:35.447960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:35.448241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:35.448518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:35.525309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:35.526852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:35.614041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:35.637017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 582/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:35.643103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:35.722441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:35.746233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522411f-8e64-4a67-ab3b-0895be176b50 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:35.780885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:35.781732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:35.782012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:35.782280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] PATH_INFO: `/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:35.783498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] RBAC: Authorizing `identity:get_project(project_id=bd8d5599edca41de9fa4f2d40bb1d70a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:35.784968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197357f8-174c-459a-b835-7c6d9c0671d9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:35.786668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 578/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:35 2022] GET /identity/v3/projects/bd8d5599edca41de9fa4f2d40bb1d70a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:35.793629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:35.909452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f82c-445e-4724-972f-a708487e32d7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:35.943874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:35.944515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:35.944822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:35.945095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:35.945921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=bd8d5599edca41de9fa4f2d40bb1d70a, user.id=bf192ebff0c54a04992a1b9a25fdb3b7) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:35.946228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:35.947708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a8fdf-2658-4c1d-adb0-1e7382b6d2c9 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:35.953612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 583/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:35 2022] GET /identity/v3/role_assignments?user.id=bf192ebff0c54a04992a1b9a25fdb3b7&scope.project.id=bd8d5599edca41de9fa4f2d40bb1d70a&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:37.974035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9f0e-5f7b-47c4-8c97-e5831cd59a37 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:37.974626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9f0e-5f7b-47c4-8c97-e5831cd59a37 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:37.974626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9f0e-5f7b-47c4-8c97-e5831cd59a37 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:37.975966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 579/1162] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:37.981444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:37.981869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:37.981982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:38.006196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:38.008017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:38.053816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:38.079900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 584/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:38.111652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9f0e-5f7b-47c4-8c97-e5831cd59a37 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:38.218815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9f0e-5f7b-47c4-8c97-e5831cd59a37 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:38.255345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:38.256001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:38.256281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:38.256583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:38.271051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:38.324302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:38.325797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:38.424070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 580/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:38.430410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:38.547006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889353a2-d3a8-49fc-bd5d-212000309151 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:38.583760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:38.584589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:38.584869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:38.585137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:38.591989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:38.593469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-6100d109-9451-455a-8600-57ac5aadf9c0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:38.608758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:38.609925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:38.611301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 585/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:01:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:38.618494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:38.672161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:38.726188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dd68a-15e0-4a66-b0c4-6aa564cfc9ea None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:38.760844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:38.761498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:38.761776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:38.762051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:38.762772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:38.763075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:38.764482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9527b-64f1-4a11-880b-123ce9df60f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:38.771883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 581/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 5 16:01:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:40.778823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a41b3-852b-4c03-85d7-5a1893824022 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:40.779384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a41b3-852b-4c03-85d7-5a1893824022 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:40.779384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a41b3-852b-4c03-85d7-5a1893824022 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:40.780787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 586/1167] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:40.786080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c65b7-d98b-48b6-a893-231697b2d628 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:40.786518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c65b7-d98b-48b6-a893-231697b2d628 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:40.786610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c65b7-d98b-48b6-a893-231697b2d628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:40.804379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f65c65b7-d98b-48b6-a893-231697b2d628 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:40.805601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f65c65b7-d98b-48b6-a893-231697b2d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:40.874372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 582/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:40.897445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a41b3-852b-4c03-85d7-5a1893824022 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:40.941586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:41.010496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a41b3-852b-4c03-85d7-5a1893824022 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:41.044906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:41.045498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:41.045777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:41.046059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:41.046791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:41.048177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c4f5b-f86f-4ab0-aed9-8effe04af638 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:41.065078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 587/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Jul 5 16:01:40 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:43.096879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03e5eb-a72c-4ce5-81a8-d1843d0997c4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:43.097435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03e5eb-a72c-4ce5-81a8-d1843d0997c4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:43.097435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03e5eb-a72c-4ce5-81a8-d1843d0997c4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:43.099633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 583/1170] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:43.107573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:43.107966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:43.108180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:43.135370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:43.136579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:43.207376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 588/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:43.239469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03e5eb-a72c-4ce5-81a8-d1843d0997c4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:43.285134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:43.351550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03e5eb-a72c-4ce5-81a8-d1843d0997c4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:43.386775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:43.387646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:43.387931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:43.388213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] PATH_INFO: `/v3/domains/8fec05e5d9c6487693976b397a06a5f8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:43.399640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fec05e5d9c6487693976b397a06a5f8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:43.401166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc680002-9f4f-4dda-be64-55d125bdc6e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:43.402809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 584/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jul 5 16:01:43 2022] GET /identity/v3/domains/8fec05e5d9c6487693976b397a06a5f8 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:43.409145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:43.440754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:43.527835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c283a-94a7-4704-a0cd-44c3ff59262c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:43.563313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:43.563969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:43.564251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:43.564553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:43.565259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:43.566695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e2bcc-67ff-4134-bf3b-bd33f428f43c None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:43.595841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 589/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:01:43 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:45.633929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574110-5366-44bc-934d-979cadac53ea None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:45.634853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574110-5366-44bc-934d-979cadac53ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:45.634853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574110-5366-44bc-934d-979cadac53ea None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:45.637241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 585/1174] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:45.645159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:45.645593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:45.645680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:45.664330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:45.665557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:45.736306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 590/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:01:45.763705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60574110-5366-44bc-934d-979cadac53ea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:45.873442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:45.878676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60574110-5366-44bc-934d-979cadac53ea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:45.917053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:45.917916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:45.918201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:45.918483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] PATH_INFO: `/v3/domains/8fec05e5d9c6487693976b397a06a5f8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:45.919710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fec05e5d9c6487693976b397a06a5f8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:45.921188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487867-552e-4478-bb03-5bd3a7d327ab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:45.922797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 586/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jul 5 16:01:45 2022] GET /identity/v3/domains/8fec05e5d9c6487693976b397a06a5f8 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:45.928801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:45.940030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:46.033235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698909f-b22f-4ade-abe4-518b8552cf38 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:46.068095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:46.068787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:46.069063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:46.069339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:46.070034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:46.071478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a44c-86cd-401c-bac9-156816ad724f None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:46.094393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 591/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:01:45 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:01:48.113464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea14cc-9cc8-46b1-b36c-15d6568b906c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.114366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea14cc-9cc8-46b1-b36c-15d6568b906c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.114366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea14cc-9cc8-46b1-b36c-15d6568b906c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.116519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 587/1178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:48.124565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.124959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.125120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.149161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:48.150694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:48.210626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:48.224957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 592/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:48.249001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea14cc-9cc8-46b1-b36c-15d6568b906c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:48.355817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea14cc-9cc8-46b1-b36c-15d6568b906c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:48.390754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:48.391471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.391755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.392038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.403089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:48.410768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:48.411807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:48.412696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 588/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:48.418232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:48.523897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4054b08-eaeb-40f2-8259-5ae1952414f2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:48.559339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:48.560007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.560286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.560595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.561345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:48.561654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:48.563039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:48.571985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 593/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:48.578221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:48.610224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:48.694729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4486492-533e-444f-b3a6-69e12d41f904 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:48.731032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:48.731901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.732186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.732421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] PATH_INFO: `/v3/users/cd2de320e452420a87895f849779c27d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.746407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cd2de320e452420a87895f849779c27d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:48.747856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:48.749543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 589/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:48 2022] GET /identity/v3/users/cd2de320e452420a87895f849779c27d => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:48.755711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:48.814500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:48.863809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117d28-ac85-4cf6-92c0-18b571b56f9d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:48.898700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:48.899343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:48.899633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:48.899908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:48.977063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:48.978447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:49.036179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:49.090707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 594/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:49.099527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:49.184146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:49.201111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f8702-7a8e-4363-a2d3-0be7647e65a9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:49.243326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:49.244211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:49.244495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:49.244793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] PATH_INFO: `/v3/projects/36d82d42eae549bb8231bd4ce452f1e6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:49.246061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] RBAC: Authorizing `identity:get_project(project_id=36d82d42eae549bb8231bd4ce452f1e6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:49.247503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d923002-d53e-4ab2-939b-4bd7b9797446 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:49.249235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 590/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:49 2022] GET /identity/v3/projects/36d82d42eae549bb8231bd4ce452f1e6 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:01:49.255446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:49.356157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07673f-125c-411f-b97f-cf73abde4fde None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:49.390564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:49.391202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:49.391485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:49.391759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:49.392609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=36d82d42eae549bb8231bd4ce452f1e6, user.id=cd2de320e452420a87895f849779c27d) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:49.392920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:49.394349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2934ba7-0e2e-4d2e-a4ac-8efb4ec15bcc None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:49.399661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 595/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:49 2022] GET /identity/v3/role_assignments?user.id=cd2de320e452420a87895f849779c27d&scope.project.id=36d82d42eae549bb8231bd4ce452f1e6&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:51.372742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694047-072e-420e-ac56-671ced857fb6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:51.373653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694047-072e-420e-ac56-671ced857fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:51.373653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694047-072e-420e-ac56-671ced857fb6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:51.375781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 591/1186] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:51.382101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:51.382546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:51.382671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:51.401249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:51.402450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:51.417226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:51.473315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 596/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:51.495735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f694047-072e-420e-ac56-671ced857fb6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:51.605275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f694047-072e-420e-ac56-671ced857fb6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:51.640369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:51.641115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:51.641395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:51.641664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:51.651823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:51.659425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:51.660599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:01:51.661861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 592/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:51.667843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:51.776776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc35adc-5247-4876-8e23-980e48de446f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:51.809894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:51.810549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:51.810828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:51.811097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:51.811835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:51.812134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:51.813549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:51.821188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 597/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:51.827059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:51.843875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:51.946684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b296-20fd-4d53-8188-aa5a198363cb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:51.985845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:51.986716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:51.986994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:51.987267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] PATH_INFO: `/v3/users/cd2de320e452420a87895f849779c27d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:51.988494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] RBAC: Authorizing `identity:get_user(user_id=cd2de320e452420a87895f849779c27d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:51.989961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:51.991576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 593/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:51 2022] GET /identity/v3/users/cd2de320e452420a87895f849779c27d => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:51.997658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:52.014079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:52.111874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493da3-e900-4aec-be12-6e2bfb021f62 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:52.147568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:52.148430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:52.148740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:52.149016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] PATH_INFO: `/v3/projects/36d82d42eae549bb8231bd4ce452f1e6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:52.150305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] RBAC: Authorizing `identity:get_project(project_id=36d82d42eae549bb8231bd4ce452f1e6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:52.151782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2fdf-ccf9-4b8c-8c87-83947cb63d9b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:52.153537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 598/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:51 2022] GET /identity/v3/projects/36d82d42eae549bb8231bd4ce452f1e6 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:52.160768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:52.248578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:52.269939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13921b-645e-4f66-9943-c77af2ae0983 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:52.304229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:52.305133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:52.305417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:52.305686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] PATH_INFO: `/v3/projects/36d82d42eae549bb8231bd4ce452f1e6/users/cd2de320e452420a87895f849779c27d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:52.307901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] RBAC: Authorizing `identity:create_grant(project_id=36d82d42eae549bb8231bd4ce452f1e6, user_id=cd2de320e452420a87895f849779c27d, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:52.309364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11e07b-aedb-4157-b08c-0174c619fe64 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:52.324840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 594/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:01:52 2022] PUT /identity/v3/projects/36d82d42eae549bb8231bd4ce452f1e6/users/cd2de320e452420a87895f849779c27d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:01:54.382227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398401-d60c-49ba-b360-8b7e9f7396ce None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:54.383103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398401-d60c-49ba-b360-8b7e9f7396ce None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:54.383103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398401-d60c-49ba-b360-8b7e9f7396ce None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:54.385557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 599/1193] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:01:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:01:54.391698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:54.392130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:54.392261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:54.418633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:01:54.419817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:01:54.489108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 595/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:01:54.513716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398401-d60c-49ba-b360-8b7e9f7396ce None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:54.609916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:54.630592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398401-d60c-49ba-b360-8b7e9f7396ce None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:54.664327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:54.665082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:54.665361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:54.665630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:54.676483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:01:54.683995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:01:54.685063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:01:54.685949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 600/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:01:54.692755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:54.760982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:54.793991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07065ef1-380b-4f39-a3d7-e70bbc6e6437 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:54.836020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:54.836709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:54.836991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:54.837264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:54.838004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:54.838313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:54.839769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:54.847984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 596/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:54.854044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:54.955712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ea4d-804e-4ed9-b878-138b17851066 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:54.989851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:54.990714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:54.990991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:54.991260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] PATH_INFO: `/v3/users/cd2de320e452420a87895f849779c27d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:54.992493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] RBAC: Authorizing `identity:get_user(user_id=cd2de320e452420a87895f849779c27d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:54.993974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:54.995650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 601/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 5 16:01:54 2022] GET /identity/v3/users/cd2de320e452420a87895f849779c27d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:55.001517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:55.109600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef90a2-214e-4688-b1c2-b83832ead764 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:55.138888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:55.144901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:55.145565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:55.145848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:55.146124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:55.214855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:55.216245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:55.319760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 597/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:01:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:55.326184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:55.337957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:55.444401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630085c8-a831-4c51-8d2c-709495dece2a None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:55.483329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:55.484067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:55.484354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:55.484670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] PATH_INFO: `/v3/projects/36d82d42eae549bb8231bd4ce452f1e6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:55.485919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] RBAC: Authorizing `identity:get_project(project_id=36d82d42eae549bb8231bd4ce452f1e6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:55.487369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb4528-b8f8-4620-8ac2-a39ddaeb7885 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:55.489129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 602/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 5 16:01:55 2022] GET /identity/v3/projects/36d82d42eae549bb8231bd4ce452f1e6 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:01:55.495422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:01:55.528237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:55.600495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3514cf-f677-4694-955d-d95e500fbcd3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:01:55.635994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:01:55.636670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:01:55.636952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:01:55.637232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:01:55.638069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=36d82d42eae549bb8231bd4ce452f1e6, user.id=cd2de320e452420a87895f849779c27d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:01:55.638384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:01:55.639835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319d6f-1d12-470e-8755-1d3b778d3eb1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:01:55.645845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 598/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:01:55 2022] GET /identity/v3/role_assignments?user.id=cd2de320e452420a87895f849779c27d&scope.project.id=36d82d42eae549bb8231bd4ce452f1e6&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:05.478272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=62 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:05.643104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=52 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:50.645066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7142c0-9929-47f4-932f-8933af588ffd None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:50.645732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7142c0-9929-47f4-932f-8933af588ffd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:50.645916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7142c0-9929-47f4-932f-8933af588ffd None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:50.647342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 603/1201] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:02:50.654075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:50.654575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:50.654763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:50.675132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:02:50.676510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:02:50.776480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 599/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:02:50.798108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7142c0-9929-47f4-932f-8933af588ffd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:50.929674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7142c0-9929-47f4-932f-8933af588ffd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:50.972636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:50.973846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:50.974244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:50.974557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:50.994923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:50.997062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:02:51.020663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:51.021951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:51.023051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:02:51.023051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:02:51.023051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:51.023051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:02:51.028863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 604/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:51.029855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:51.177427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6858-6fa5-45d0-afa8-0b2a286c12c0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:51.216495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:51.225433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:51.226198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:51.226493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:51.226820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:51.227702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:51.228010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:51.234377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7653d-521f-4e78-a8f0-2e42f6d64907 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:51.251821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 600/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:51.255759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:51.321491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:51.377147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6a0a-75df-4675-a18e-a0ccbfeddb6b None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:51.432471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:51.432966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:51.433282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:51.433562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:51.434257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:51.435751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e91516-29e8-4f13-8e09-7ce4acf73187 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:51.472484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 605/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 5 16:02:51 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:02:53.731590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ff7b-eb21-4241-b5a9-218848755245 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:53.732169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ff7b-eb21-4241-b5a9-218848755245 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:53.732169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ff7b-eb21-4241-b5a9-218848755245 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:53.734033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 601/1206] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:02:53.739716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:53.740183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:53.740364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:53.759076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:02:53.760389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:02:53.836991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 606/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:02:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 16:02:53.863011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7ff7b-eb21-4241-b5a9-218848755245 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:53.986083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7ff7b-eb21-4241-b5a9-218848755245 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.025686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.026509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.026787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.027064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.038805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:02:54.048915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:54.050149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:02:54.051234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:54.061043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 602/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:54.061227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:54.101975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:54.177656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9b190-0e99-44c0-8ce6-b58cf1684160 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.217634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.218385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.218635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.218915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.219671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:54.219983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:54.221420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:54.230534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 607/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:54.237032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:54.293027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:54.354807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110261-0da0-4bc6-9969-29c9e79bb364 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.403588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.404402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.404718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.404995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.416589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:54.418101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:02:54.435691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:54.436980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:54.437881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:02:54.437881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:02:54.437881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:54.437881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:54.437881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 603/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:54.443524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:54.555235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:54.558434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414d773-ae01-462d-acd4-e5fc447b9b54 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.598019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.600678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.600678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.600678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.600963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:54.601169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:54.604090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:54.628209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 608/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:02:54.629969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:54.738450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed18be-9a89-4108-9c70-96fd9a7ef7dc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.740265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:54.778157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.779237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.779389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.779600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.787622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:54.789127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:02:54.804713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:54.805970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:54.807307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 604/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:54.812124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:54.924060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739703c0-bdde-4724-9a39-7738b7e292eb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:54.964948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:54.966050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:54.966570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:54.967101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:54.968237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:54.968686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:54.970620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:54.995181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 609/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:54.996172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:55.124240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc0c8-dec4-44ee-9f0d-d0efac1369e8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:55.170066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:55.172378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:55.172378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:55.172378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:55.214167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:55.273545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:55.275844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:55.405463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 605/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:02:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:02:55.406020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:55.433891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:55.545071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d270f-6b58-40a2-b616-c41053103f22 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:55.582916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:55.583726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:55.584007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:55.584281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:55.595123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:55.596667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:02:55.617188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:55.618330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:55.619578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:02:55.619578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:02:55.619578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:55.619578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:02:55.624492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 610/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:55.625203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:55.702866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:55.751736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84691-047f-42c3-b89a-3664358876e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:55.787827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:55.788702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:55.789088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:55.789467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:55.790293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:55.790705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:55.792265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:55.805612 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 606/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:55.811814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:55.885000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:55.921167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19581-18fc-405b-8bf5-9dd2c29741e2 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:55.959307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:55.960027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:55.960310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:55.960629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:55.968280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:55.969837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:02:55.984681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:55.985637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:02:55.986549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 611/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:02:55.994209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:56.112907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851f53-9fe9-4b3c-beaf-dd85102070cc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:56.140746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:56.155322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:56.156070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:56.156415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:56.156773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:56.157665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:56.158038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:56.159531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7e17c-555d-40c5-9430-bbfe52c81ec7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:56.172251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 607/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:56.179241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:56.300316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690dc8b-bcd1-4cdf-8abe-ce008a6c81b7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:56.337051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:56.344413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:56.345216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:56.345594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:56.346021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:56.347045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=0cfb966c12ea4f60a7682649c7a5cfee) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:56.347627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:56.349552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801f55d-d67e-4fd0-862b-e16ef518d785 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:56.368499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 612/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:02:56 2022] GET /identity/v3/role_assignments?user.id=0cfb966c12ea4f60a7682649c7a5cfee&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:58.468724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd307a-9174-49c0-9c67-cdd024226a67 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:58.469294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd307a-9174-49c0-9c67-cdd024226a67 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:58.469294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd307a-9174-49c0-9c67-cdd024226a67 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:58.471035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 608/1220] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:02:58.476770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:58.477245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:58.477371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:58.496125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:02:58.497483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:02:58.570034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 613/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:02:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:02:58.595124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd307a-9174-49c0-9c67-cdd024226a67 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:58.703828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd307a-9174-49c0-9c67-cdd024226a67 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:58.741196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:58.741934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:58.742250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:58.742523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:58.754459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:02:58.762902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:58.764038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:02:58.765102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:58.769783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 609/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:58.770971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:58.874431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba883ed-abaa-4f9a-a057-15e1db82572e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:58.899690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:58.914075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:58.914813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:58.915153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:58.915420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:58.916266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:58.916655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:58.918122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:58.926890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 614/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:02:58.933082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:58.978045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:59.038709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0370c-ea2b-4250-b539-fb30422bfb36 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.075510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.076320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.076633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.076912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.088477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.090015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:02:59.107156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:59.108213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:59.109343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:02:59.109343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:02:59.109343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:59.109343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:59.109343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 610/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:59.114610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:59.218488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8187-a583-4e4b-a45c-79276e85e1fd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.257873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.258649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.258982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.259266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.260246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:59.260669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.262274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.275564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 615/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:59.282040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:59.383263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:59.394851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80266-9b6f-4fd2-a2f6-e0c6ae9a7904 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.433034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.433927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.434227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.434599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.443228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.444924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:02:59.461147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:59.462349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:59.463375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 611/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:59.470845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:59.519922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:59.577217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab931-afce-4cff-a4f9-989da02c09a7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.615450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.616133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.616417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.616726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.617565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:59.617874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.619552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.639200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 616/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:02:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:02:59.645070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:59.754281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ffdf5-ae5c-4d38-83e5-7ef864150038 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.790555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.791427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.791743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.792010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.804647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.806276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:02:59.824559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:02:59.825683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:02:59.826747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:02:59.826747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:02:59.826747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:02:59.826747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:02:59.826747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 612/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:02:59.832201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:02:59.944819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c6ea-6e3b-495b-b494-e41b9c65c1aa None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:02:59.947322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:59.982977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:02:59.983657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:02:59.983935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:02:59.984207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:02:59.985094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:02:59.985527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:02:59.986881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:02:59.999409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 617/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:03:00.005304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:00.015829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:00.118352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6e16-079c-4a3b-835d-1f52808ddfe5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:00.153892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:00.154733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:00.155016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:00.155292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:00.162823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:00.164347 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:03:00.181253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:00.182471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:00.183476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 613/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:00.188920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:00.300806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721cb12-18cf-407b-a4c7-50bfd97983bd None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:00.338537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:00.339240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:00.339561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:00.339839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:00.340661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:00.340970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:00.342521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48f157-79d8-4da2-beff-722c39d25c1e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:00.355429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 618/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:00.362130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:00.435865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:00.477974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef0324-0341-4cd6-b276-225ed49ad7d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:00.514475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:00.515381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:00.515663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:00.515962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/0cfb966c12ea4f60a7682649c7a5cfee/roles/415166a84ac64393a6e35c2ff5b302cc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:00.532315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=0cfb966c12ea4f60a7682649c7a5cfee, role_id=415166a84ac64393a6e35c2ff5b302cc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:00.533821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54ee68-ab6f-4a1c-9993-14c44f8b761c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:00.547436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 614/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:03:00 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/0cfb966c12ea4f60a7682649c7a5cfee/roles/415166a84ac64393a6e35c2ff5b302cc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:03:02.607446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8e51-52d6-485b-a2b1-78bc3af49ac8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:02.608287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8e51-52d6-485b-a2b1-78bc3af49ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:02.608287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a8e51-52d6-485b-a2b1-78bc3af49ac8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:02.609428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 619/1233] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:02.615952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:02.616413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:02.616614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:02.635648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:02.637004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:02.706582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 615/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:02.730730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a8e51-52d6-485b-a2b1-78bc3af49ac8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:02.757575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:02.837354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a8e51-52d6-485b-a2b1-78bc3af49ac8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:02.873024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:02.873986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:02.874284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:02.874648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:02.886828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:03:02.894700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:02.896426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 16:03:02.898043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:02.904487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 620/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 5 16:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:02.904651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:02.956064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:03.013723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ee327-0c3b-4605-b0bb-35da8eec6044 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.051459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.052202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.052681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.053019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:03.053996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:03.054349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:03.056384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:03.069012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 616/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 5 16:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:03.074961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:03.172835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:03.190927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d09ea-e200-4dd7-bb67-dcc6a2c31ea7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.228643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.229534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.229808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.230115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:03.243088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:03.244867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:03.264169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:03.265616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:03.266724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:03.266724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:03.266724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:03.266724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:03.266724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 621/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:03.271689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:03.389152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9684-d101-4a06-9ca8-6948d497560c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.399991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:03.425994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.426669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.427018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.427309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:03.428027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:03.428338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:03.429762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:03.442299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 617/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:03.448159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:03.563072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13a30-b939-4e32-b7a7-76175ba0e2b6 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.602525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.603570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.603971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.604276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:03.607820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:03.614359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:03.616228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:03:03.632696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:03.633930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:03.636179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 622/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:03:03.640078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:03.758567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe3e7-4dea-47c1-932f-81ae1b519a95 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.797904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.798755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.799188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.799570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:03.800614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:03.800974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:03.802662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:03.830138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 618/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:03:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:03.831401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:03.935388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8dac7-e85b-429c-9490-6a0e0b579720 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:03.970223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:03.970908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:03.971188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:03.971463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:04.039612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:04.046887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:04.048491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:04.157510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 623/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:03:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:03:04.163591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:04.195466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:04.280869 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603658-24ce-4388-ad21-97e9b5664696 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:04.322249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:04.323124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:04.323407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:04.323711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:04.335913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:04.337443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:04.355123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:04.356237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:04.357203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:04.357203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:04.357203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:04.357203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:04.357203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 619/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:04.362781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:04.462910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:04.469546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab16b4-a044-45d6-9249-7d5078084753 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:04.507400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:04.508115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:04.508424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:04.508712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:04.509478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:04.509786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:04.511203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:04.523570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 624/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:04.529570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:04.615453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:04.640369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80062c0-7e5a-4662-949f-b366c8f4159c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:04.676310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:04.677240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:04.677526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:04.677801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:04.685310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:04.686865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:03:04.701061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:04.702490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:04.704555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 620/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:04.710052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:04.822184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed566e5-2703-4d37-acad-4ebf09b9e783 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:04.857463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:04.858189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:04.858502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:04.858819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:04.859682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:04.860019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:04.861618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c62fb-76f0-4141-bbae-f2e1a97f79a1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:04.874917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 625/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:04.881143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:04.990870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a7bfb-5186-4a10-8b1e-76671c792b51 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:05.029777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:05.030436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:05.030720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:05.030988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:05.031806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] RBAC: Adding query filter params (role.id=415166a84ac64393a6e35c2ff5b302cc, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=0cfb966c12ea4f60a7682649c7a5cfee) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:05.032112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:05.033745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f655-0c6a-49aa-96e1-d249a1154b87 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:05.039603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 621/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:03:04 2022] GET /identity/v3/role_assignments?user.id=0cfb966c12ea4f60a7682649c7a5cfee&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=415166a84ac64393a6e35c2ff5b302cc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:03:07.219625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c35e-632a-458b-a33a-4c26d758a2a6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:07.220199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c35e-632a-458b-a33a-4c26d758a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:07.220199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c35e-632a-458b-a33a-4c26d758a2a6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:07.221676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 626/1247] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:07.228660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:07.229444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:07.229444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:07.235033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:07.248144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:07.249580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:07.327283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 622/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:07.355300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956c35e-632a-458b-a33a-4c26d758a2a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:07.379560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:07.474908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956c35e-632a-458b-a33a-4c26d758a2a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:07.516558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:07.517539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:07.517987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:07.518332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:07.531631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:03:07.540197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:07.541390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:07.542417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:07.547034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 627/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:07.548625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:07.663611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e8ca-ef22-4131-8a8b-bf94d99d009a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:07.701903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:07.708140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:07.708937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:07.709217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:07.709487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:07.710315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:07.710685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:07.712316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:07.726324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 623/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:07.727688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:07.815028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:07.842151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445588d1-0f40-42a3-9c65-d1c5d81a14da None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:07.880747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:07.881557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:07.881839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:07.882115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:07.893579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:07.895191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:07.917146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:07.918082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:07.919000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:07.919000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:07.919000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:07.919000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:07.919000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 628/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:03:07.924395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:08.038565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb724-ee5b-42bb-ba39-d894980200d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:08.078866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:08.079555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:08.079819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:08.080100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:08.080998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:08.081305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:08.082774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:08.101114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 624/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:08.102465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:08.217948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dfadb-56d1-4dcc-8730-ea5f31dddb8d None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:08.252000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:08.261878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:08.262743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:08.263097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:08.263434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:08.272316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:08.274005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:03:08.291410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:08.297362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:08.298562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 629/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:08.299237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:08.362504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:08.410374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537efec-4a6e-465d-8994-c4fff068f1f2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:08.447228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:08.447960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:08.448269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:08.448564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:08.449536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:08.449926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:08.451364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:08.472282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 625/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:03:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:03:08.478331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:08.598789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db2e0f-65c7-4c6f-983e-4c6448617194 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:08.637056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:08.637707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:08.637986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:08.638257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:08.697632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:08.714710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:08.716265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:08.830718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 630/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:03:08.832631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:08.944599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb493-b84c-4e85-b55f-70795205dca1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:08.962261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:08.987549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:08.988654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:08.988941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:08.989245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:09.001337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:09.002983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:09.026021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:09.027193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:09.032832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:09.032832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:09.032832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:09.032832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:09.032832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 626/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 16:03:09.034072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:09.136299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:09.149619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf77e-b621-4dea-91ce-824b2b21cf54 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:09.187451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:09.188119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:09.188423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:09.188728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:09.189444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:09.189716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:09.191148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:09.203796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 631/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:09.210421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:09.325819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c1ca3-3fa2-487f-8655-6301c9615772 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:09.361655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:09.362464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:09.362748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:09.363025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:09.369771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:09.371228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:03:09.386100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:09.387223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:09.388506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 627/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:09.394151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:09.503449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c345-a607-4817-a6d9-25f0076a45b7 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:09.541324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:09.542167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:09.542503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:09.542912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:09.543826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:09.544237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:09.546062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82776bf-6e53-4a5f-a767-3d310f4ad4b6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:09.559955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 632/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:03:09.566325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:09.594413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:09.675638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa06fa-946d-4ddc-b641-fd5890366390 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:09.712993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:09.713713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:09.714072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:09.714351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:09.715285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=0cfb966c12ea4f60a7682649c7a5cfee) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:09.715589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:09.717134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d42cd-bdce-47b8-b2f3-52f7e477d716 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:09.723339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 628/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:03:09 2022] GET /identity/v3/role_assignments?user.id=0cfb966c12ea4f60a7682649c7a5cfee&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:03:11.749053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5798b0-ad5c-4316-bc5e-93b35c06ba8d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:11.749910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5798b0-ad5c-4316-bc5e-93b35c06ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:11.750015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5798b0-ad5c-4316-bc5e-93b35c06ba8d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:11.752140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 633/1261] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:11.758688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:11.759183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:11.759401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:11.788208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:11.790595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:11.872760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 629/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:11.896370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5798b0-ad5c-4316-bc5e-93b35c06ba8d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:11.908894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.003368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5798b0-ad5c-4316-bc5e-93b35c06ba8d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.039661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.040492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.040763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.041037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.051707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:03:12.059373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:12.060402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:12.061422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 634/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:12.066924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:12.086193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.169656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596924-3378-4f29-9afb-3f84fb2ae6a4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.205490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.206194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.206478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.206756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.207505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:12.207817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:12.209235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:12.217606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 630/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:12.223796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:12.303313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.340677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf93049-d2f8-45d3-aa4a-71a1deb25f34 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.374691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.375483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.375758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.376023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.387560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:12.389057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:12.406121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:12.407152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:12.408439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:12.408439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:12.408439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:12.408439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:12.408439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 635/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:12.416154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:12.501715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.524715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191024-c866-4abf-9e75-b5d265397311 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.560904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.561503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.561783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.562054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.562773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:12.563083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:12.564483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:12.577633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 631/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:12.583895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:12.694159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cf876-87f0-45a8-8875-32e5cf96c82e None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.713730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.729938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.730729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.731000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.731290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.739187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:12.740658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:03:12.754802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:12.756335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:12.757633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 636/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:12.762965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:12.868197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dda382-cd7b-4e21-9ac5-226c051a24f3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:12.903143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:12.903799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:12.904077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:12.904346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:12.905210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:12.905512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:12.906942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:12.915682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:12.924568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 632/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:12.930486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:13.032163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9f1e2-0d7c-4d45-bafb-1da93a19a7ae None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:13.066816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:13.067593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:13.067871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:13.068147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:13.079124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:13.080581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:13.098337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:13.099316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:13.100367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:13.100367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:13.100367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:13.100367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:13.100367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 637/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:13.105385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:13.210366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61595e1-f8b1-44ea-960d-1983e96d6f95 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:13.245035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:13.245699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:13.245975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:13.246250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:13.246975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:13.247294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:13.248870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:13.260505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 633/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:13.267797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:13.308110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:13.378071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094dc3-a078-4d60-b493-080db6f989b0 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:13.415381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:13.416180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:13.416491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:13.416765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:13.423969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:13.425446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:03:13.440016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:13.441070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:13.441995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 638/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:13.449241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:13.513261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:13.558571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2677a-a608-4949-908f-9361103a5786 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:13.594335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:13.594985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:13.595266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:13.595537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:13.596316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:13.596649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:13.598092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff627a-168c-4f88-8624-3afbfed7e927 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:13.611114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 634/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:13.620109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:13.711385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:13.721473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae840e8-726a-4469-b5d5-7c0c84723abb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:13.760186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:13.761082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:13.761358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:13.761627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] PATH_INFO: `/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/0cfb966c12ea4f60a7682649c7a5cfee/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:13.763806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09209f66de74ba69bbe6f3df5d69610, user_id=0cfb966c12ea4f60a7682649c7a5cfee, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:13.765277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46cc0d-6c96-416d-b26d-2234b6c70cd1 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:13.785023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 639/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 5 16:03:13 2022] PUT /identity/v3/projects/a09209f66de74ba69bbe6f3df5d69610/users/0cfb966c12ea4f60a7682649c7a5cfee/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:03:15.768219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26945a-11f8-4a5d-b206-e594531ba729 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:15.768804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26945a-11f8-4a5d-b206-e594531ba729 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:15.768804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26945a-11f8-4a5d-b206-e594531ba729 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:15.770205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 635/1274] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:15.776539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:15.777221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:15.777450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:15.806596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:15.807802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:15.877669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 640/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:15.901347 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26945a-11f8-4a5d-b206-e594531ba729 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.015392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26945a-11f8-4a5d-b206-e594531ba729 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.032808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:16.061273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.062088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.062373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.062656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.074181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 16:03:16.082157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:16.083268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:16.084244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 636/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 5 16:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:16.089502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.173954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:16.195229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde50700-50df-4ab4-a11a-c347d135ec77 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.228578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.229304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.229608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.229912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.230736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:16.231059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:16.232638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:16.243181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 641/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:16.251384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.357146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efd93-a5dc-4333-9236-9054118fddbb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.391721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.392498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.392806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.393067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.403510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:16.405007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:16.422369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:16.423370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:16.424369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:16.424369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:16.424369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:16.424369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:16.424369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 637/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:16.431642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.540324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfa9a-6344-41b5-bf9f-9cee52246e05 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.574507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.575172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.575452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.575729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.576466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:16.576781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:16.578532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:16.590401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 642/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:16.597097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.637114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:16.710442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13776c5-e3e1-4fc4-84f0-a19d96d2e552 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.745404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.746191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.746470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.746740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.753784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:16.755247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 16:03:16.769912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:16.771413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:16.772589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 638/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:16.778917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:16.782987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:16.889674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028a281-8131-4631-b8ae-303a11bbdf28 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:16.923984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:16.924678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:16.924955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:16.925228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:16.926056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:16.926365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:16.927792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:16.944570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 643/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:16.951113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:17.053629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:17.070059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3e937-8a9f-4b10-b23f-5edf9fc89ed6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:17.108804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:17.109441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:17.109720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:17.109991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:17.184565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:17.185944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:17.285789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:17.296603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 639/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 5 16:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 16:03:17.302685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:17.368050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:17.416822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344cb8-18f9-4bc7-a9f7-74d9c91c3e61 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:17.451887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:17.452984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:17.453221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:17.453523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:17.464806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:17.466250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 16:03:17.484873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:17.485898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:17.486887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 16:03:17.486887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 16:03:17.486887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 16:03:17.486887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:17.486887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 644/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:17.492708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:17.599578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d07030-7728-42ae-9252-196d20b79360 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:17.635846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:17.636497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:17.636808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:17.637086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:17.637802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:17.638112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:17.639498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:17.650780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 640/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 5 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:17.656677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:17.763461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5fe1-a855-42f0-92ee-7f27673a71b4 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:17.777241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:17.803161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:17.803947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:17.804232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:17.804544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:17.811388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:17.812870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 16:03:17.826555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:17.827907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: ERROR keystone.server.flask.application Jul 05 16:03:17.829159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 645/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 5 16:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:17.833838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:17.887196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:17.941869 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6598-8ea2-4ce2-91ad-e7dae69c8d6e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:17.977274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:17.977930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:17.978218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:17.978493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:17.979275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:17.979586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:17.981068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83fd3e-55db-4054-874b-97344832ecb6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:17.993214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 641/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 5 16:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:17.999569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:18.112222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f3e9-a6fc-4a8d-b91f-d552bb050c63 None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:18.145876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:18.146510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:18.146787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:18.147058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:18.147877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] RBAC: Adding query filter params (role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6, scope.project.id=a09209f66de74ba69bbe6f3df5d69610, user.id=0cfb966c12ea4f60a7682649c7a5cfee) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:18.148179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:18.149743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1a853-d888-4900-926b-68c7fae1078a None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:18.155671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 646/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 5 16:03:17 2022] GET /identity/v3/role_assignments?user.id=0cfb966c12ea4f60a7682649c7a5cfee&scope.project.id=a09209f66de74ba69bbe6f3df5d69610&role.id=e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:20.165518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee859-43e6-41ae-b4bf-f073886b83ef None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:20.166085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee859-43e6-41ae-b4bf-f073886b83ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:20.166085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee859-43e6-41ae-b4bf-f073886b83ef None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:20.167451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 642/1288] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:20.173868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:20.174606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:20.174752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:20.196322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:20.197550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:20.244326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:20.286239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 647/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:20.311954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee859-43e6-41ae-b4bf-f073886b83ef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:20.435292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee859-43e6-41ae-b4bf-f073886b83ef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:20.447267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:20.474360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:20.475161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:20.475441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:20.475716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:20.476375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:20.477790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:20.490089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:20.491280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:20.492514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 643/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:03:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:20.499081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:20.613512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac708c-104d-4030-bb25-9424b4a2cb83 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:20.659658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:20.660703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:20.661104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:20.661494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:20.662599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:20.663047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:20.665199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f0d2a-9ad8-4bf1-97d0-eff8c70c3e52 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:20.670749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 648/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 5 16:03:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:20.676864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:20.796541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e2fa-ce2a-45f0-9872-54fbd952a749 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:20.830429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:20.831093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:20.831379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:20.831656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:20.832365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] RBAC: Adding query filter params (type=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:20.832706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:20.834094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f43cb-2c15-4424-8ef4-193bc11591ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:20.838629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 644/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 5 16:03:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:22.853637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbfe66-2976-4153-b61a-071a1492c81d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:22.854229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbfe66-2976-4153-b61a-071a1492c81d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:22.854229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbfe66-2976-4153-b61a-071a1492c81d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:22.855615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 649/1293] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:22.861928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7130-71a7-4213-a07c-d1b723a21313 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:22.862662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7130-71a7-4213-a07c-d1b723a21313 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:22.862817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7130-71a7-4213-a07c-d1b723a21313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:22.887898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2fec7130-71a7-4213-a07c-d1b723a21313 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:22.889108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2fec7130-71a7-4213-a07c-d1b723a21313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:22.924413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:22.963831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 645/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:22.986790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbfe66-2976-4153-b61a-071a1492c81d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:23.021672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:23.114089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbfe66-2976-4153-b61a-071a1492c81d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:23.148710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:23.149437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:23.149715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:23.149989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:23.150700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:23.152077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99e2d-3963-4be1-a4f7-3aac93ccffa6 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:23.170314 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 650/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 5 16:03:22 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:03:25.162857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162209-09cc-4f37-a962-206cbb6e5b73 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.163715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162209-09cc-4f37-a962-206cbb6e5b73 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.163715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162209-09cc-4f37-a962-206cbb6e5b73 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.166270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 646/1296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:25.171599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.172034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.172141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.194721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:25.196402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:25.282293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 651/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:25.305983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162209-09cc-4f37-a962-206cbb6e5b73 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:25.408555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162209-09cc-4f37-a962-206cbb6e5b73 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:25.446825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:25.447550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.447828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.448102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.448802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:25.450180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:25.462509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:25.463609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:25.464674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 647/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:03:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:25.471188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:25.496755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:25.578548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed65da-1416-4e7e-9ae8-aeb1d06f432d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:25.614986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:25.615647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.615927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.616208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.616945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:25.617259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:25.618640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:25.624201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 652/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 5 16:03:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:25.630559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:25.663792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:25.738087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923522e0-fb41-4cb1-8761-af202e4a3dd9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:25.776418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:25.777110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.777392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.777673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.778469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] RBAC: Adding query filter params (interface=public, service_id=c220c55eefe743e5b8d91d46958dfc25, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:25.778785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:25.780179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb86a-eea6-48c2-81f2-6dbdadff5bab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:25.785662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 648/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 5 16:03:25 2022] GET /identity/v3/endpoints?service_id=c220c55eefe743e5b8d91d46958dfc25&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:25.791587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:25.876222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:25.895496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c482e-d887-4ae2-a34f-f6d58ff103eb None admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:25.932207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:25.933315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:25.933315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:25.934052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:25.934143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:25.935521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156639-de80-46fe-b977-1d076f93c6f2 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:25.942598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 653/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 5 16:03:25 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:03:27.919857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e16f-6a36-4969-b523-ca75df95ee36 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:27.920793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e16f-6a36-4969-b523-ca75df95ee36 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:27.920793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e16f-6a36-4969-b523-ca75df95ee36 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:27.922981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 649/1302] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:03:27.931668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:27.932090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:27.932293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:27.955791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:03:27.957019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:03:28.026060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 654/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:03:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 16:03:28.049438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817e16f-6a36-4969-b523-ca75df95ee36 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:28.159650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:28.168019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817e16f-6a36-4969-b523-ca75df95ee36 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:28.203193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:28.203917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:28.204198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:28.204493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:28.205158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:28.206538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 16:03:28.218594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 16:03:28.219757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application with Lock( Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self._enter() Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application return self.creator() Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application created_value = creator( Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: ERROR keystone.server.flask.application Jul 05 16:03:28.220836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 650/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 5 16:03:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 16:03:28.225938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:28.308841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:28.335847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae73cc-fe27-48c1-b333-792b02b2887b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:28.370893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:28.371552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:28.371825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:28.372098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] PATH_INFO: `/v3/services` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:28.372834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:03:28.373137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:28.374535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7801e5-4b9f-42b8-a9a1-16ba6aa8c7b3 None admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:28.379837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 655/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 5 16:03:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:03:28.389190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:03:28.499460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14943bd-4198-4cd7-9d3c-d29702f7c3cd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:03:28.535359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:03:28.536016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:03:28.536298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:03:28.536616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:03:28.537353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:03:28.538732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0530-1d0d-4730-975c-1b25311d9cd5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:03:28.560160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 651/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 5 16:03:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:03:38.376641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=30 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:38.555601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:31.824957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf23c5-6354-4867-bbc5-c5234b5228cb None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:31.825839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf23c5-6354-4867-bbc5-c5234b5228cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:31.825949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf23c5-6354-4867-bbc5-c5234b5228cb None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:31.831474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 656/1307] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:31.833193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb40d6-a900-4e6c-a1a3-65d8119812b2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:31.834012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb40d6-a900-4e6c-a1a3-65d8119812b2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:31.834458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb40d6-a900-4e6c-a1a3-65d8119812b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:31.989415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bfeb40d6-a900-4e6c-a1a3-65d8119812b2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:31.990941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bfeb40d6-a900-4e6c-a1a3-65d8119812b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:32.102228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 652/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:04:32.150935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:32.151200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:32.151516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:32.153126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 657/1309] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jul 5 16:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:32.159206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b65e3-f533-4bc7-a9d8-6657db49c3b8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:32.159658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b65e3-f533-4bc7-a9d8-6657db49c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:32.160016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b65e3-f533-4bc7-a9d8-6657db49c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:32.238953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-548b65e3-f533-4bc7-a9d8-6657db49c3b8 None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:32.240394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-548b65e3-f533-4bc7-a9d8-6657db49c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:32.262874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:32.320373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 653/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 5 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:32.329863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:32.331705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:32.446705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b163f5e-fba2-4640-b79d-3e1eced8e043 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:32.531599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:32.532339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:32.532730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:32.533091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:32.534824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:32.591400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:32.648577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:32.650214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e149d-20fb-4afe-9a5e-7cd926f4b476 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:32.670119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 658/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:34.983296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:34.983846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:34.983846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:34.985473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 654/1312] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:34.990692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa350c8-e8b1-40b0-9feb-26fdfa1bbf3a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:34.991190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa350c8-e8b1-40b0-9feb-26fdfa1bbf3a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:34.991190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa350c8-e8b1-40b0-9feb-26fdfa1bbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:35.082333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3fa350c8-e8b1-40b0-9feb-26fdfa1bbf3a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:35.084115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3fa350c8-e8b1-40b0-9feb-26fdfa1bbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:35.203006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 659/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:04:35.242182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:35.248410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:35.364296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc63fd0-ffbf-40dc-a7f7-3765fd340fd2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:35.437744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:35.440318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:35.441264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:35.441519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:35.441826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:35.443862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:35.561293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:35.562767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f346ae-fa07-4c3d-aea1-f42474d2926c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:35.586723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 655/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:37.904096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:37.904991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:37.904991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:37.907661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 660/1315] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:37.915639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89a2d-bad3-40ad-9c34-6ba08835065d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:37.916075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89a2d-bad3-40ad-9c34-6ba08835065d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:37.916166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89a2d-bad3-40ad-9c34-6ba08835065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:37.982802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d4f89a2d-bad3-40ad-9c34-6ba08835065d None None] MFA Rules not processed for user `6b9362973b5a47cba4f2a0e6e0f1c8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:37.983994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d4f89a2d-bad3-40ad-9c34-6ba08835065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:38.045321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:38.093132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 656/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:04:38.134955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:38.136477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:38.146608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:38.258170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb94df-a1be-40f0-a33b-05cdb03892db None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:38.344598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:38.345254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:38.345531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:38.345802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:38.347448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:38.410351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:38.459559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:38.461042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7fcb6-7854-4149-9488-6549d2d44c87 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:38.480398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 661/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:04:41.037406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5c0d5-ccb8-4d6c-b629-5b11045d897a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:41.038282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5c0d5-ccb8-4d6c-b629-5b11045d897a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:41.038282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5c0d5-ccb8-4d6c-b629-5b11045d897a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:41.040521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 657/1318] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:41.045875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25092-fdef-4c75-8758-e676b07c41b2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:41.046307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25092-fdef-4c75-8758-e676b07c41b2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:41.046399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25092-fdef-4c75-8758-e676b07c41b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:41.114713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ddb25092-fdef-4c75-8758-e676b07c41b2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:41.115943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ddb25092-fdef-4c75-8758-e676b07c41b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:41.227742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 662/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:41.291234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:41.291429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:41.291695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:41.293139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 658/1320] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jul 5 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:41.299274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e037-abc3-40d0-90d7-4f3af031c1fc None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:41.299562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e037-abc3-40d0-90d7-4f3af031c1fc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:41.299838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e037-abc3-40d0-90d7-4f3af031c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:41.329839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:41.387671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c299e037-abc3-40d0-90d7-4f3af031c1fc None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:41.388951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c299e037-abc3-40d0-90d7-4f3af031c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:41.471819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 663/1321] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 5 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:41.481282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:41.482884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:41.589066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfb2a4-95b9-444e-a199-195906fc8c5b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:41.671051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:41.671691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:41.671971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:41.672239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:41.673949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:41.681794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:41.797783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:41.799231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e65fe-e1cc-41e6-bc2f-23f60524bbbd service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:41.819330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 659/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:44.983907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:44.984534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:44.984534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:44.985881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 664/1323] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:44.991316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d4ec-71f6-4e4f-b623-cd9bedc2f513 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:44.991750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d4ec-71f6-4e4f-b623-cd9bedc2f513 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:44.991844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d4ec-71f6-4e4f-b623-cd9bedc2f513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:45.060897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6b76d4ec-71f6-4e4f-b623-cd9bedc2f513 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:45.062140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6b76d4ec-71f6-4e4f-b623-cd9bedc2f513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:45.128862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:45.173416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 660/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:45.210163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:45.211791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:45.326498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12163291-0e19-4fb6-a6bf-1a5fa80ed7b6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:45.338961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:45.404408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:45.405117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:45.405401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:45.405674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:45.407319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:45.521561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:45.523043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66ae9-23e9-4142-98dd-3a7974cf9108 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:45.544971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 665/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:47.586003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:47.586551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:47.586551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:47.588069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 661/1326] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:47.593436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddfdf-32c4-4aa7-9a85-841b7f415231 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:47.593890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddfdf-32c4-4aa7-9a85-841b7f415231 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:47.593979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcddfdf-32c4-4aa7-9a85-841b7f415231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:47.643614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:47.662506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fdcddfdf-32c4-4aa7-9a85-841b7f415231 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:47.663738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fdcddfdf-32c4-4aa7-9a85-841b7f415231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:47.763475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 666/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:47.799410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:47.801013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:47.910315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217520-d79a-4bf6-b3be-ab1780a74924 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:47.991833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:47.992484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:47.992853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:47.993126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:47.994758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:48.012882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:48.106472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:48.107920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2236-0d65-410e-8d52-8eea3b8ae8d9 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:48.135228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 662/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:50.196288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:50.196876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:50.196876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:50.198248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 667/1329] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:50.204028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9a6-db6b-4528-82fa-957e495df3a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:50.204550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9a6-db6b-4528-82fa-957e495df3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:50.204550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9a6-db6b-4528-82fa-957e495df3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:50.276885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-47e8a9a6-db6b-4528-82fa-957e495df3a9 None None] MFA Rules not processed for user `6b9362973b5a47cba4f2a0e6e0f1c8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:50.278105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-47e8a9a6-db6b-4528-82fa-957e495df3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:50.348801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:50.383306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 663/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:50.421133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:50.422748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:50.535329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802efbb3-620f-44c5-9c8c-4f37f40f259f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:50.557323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:50.612968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:50.613625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:50.613903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:50.614176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:50.615833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:50.736475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:50.738559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e530-f6ca-4964-85c5-a38ffec1c434 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:50.769563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 668/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:53.059787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:53.060872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:53.060872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:53.062974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 664/1332] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:53.071911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3711ac-3916-4c67-8592-1dd026edc37d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:53.072352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3711ac-3916-4c67-8592-1dd026edc37d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:53.072523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3711ac-3916-4c67-8592-1dd026edc37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:53.141425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:53.145420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9e3711ac-3916-4c67-8592-1dd026edc37d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:53.147091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9e3711ac-3916-4c67-8592-1dd026edc37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:53.252965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 669/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:53.292345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:53.294919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:53.411596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7a4d6-d8fe-410d-b0d2-714880fc0436 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:53.491623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:53.492293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:53.492759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:53.493042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:53.494715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:53.529852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:53.617940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:53.619402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f157dc-a8b4-4e49-b433-e883971e7c2b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:53.637799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 665/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:55.706823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:55.707707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:55.707707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:55.710024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 670/1335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:55.715439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a1b3-3b45-4ca3-b82b-cb1644e05ba2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:55.715885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a1b3-3b45-4ca3-b82b-cb1644e05ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:55.715991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a1b3-3b45-4ca3-b82b-cb1644e05ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:55.799746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8a47a1b3-3b45-4ca3-b82b-cb1644e05ba2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:55.800987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a47a1b3-3b45-4ca3-b82b-cb1644e05ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:55.885738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:55.913369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 666/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:55.958043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:55.959608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:56.078532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734e2c2-0174-4bf3-be7f-8830b338284d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:56.112814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:56.162920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:56.163569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:56.163854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:56.164125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:56.165817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:56.277563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:56.279020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8207-beb8-4ebc-8dc1-c78b1b7b71b3 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:56.297141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 671/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:04:58.710443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:58.711366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:58.711366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:58.713736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 667/1338] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:04:58.722458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206032c5-c7d8-4de8-b890-6d50994d50cb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:58.722892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206032c5-c7d8-4de8-b890-6d50994d50cb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:58.723050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206032c5-c7d8-4de8-b890-6d50994d50cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:58.791683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-206032c5-c7d8-4de8-b890-6d50994d50cb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:04:58.792991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-206032c5-c7d8-4de8-b890-6d50994d50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:58.801483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:58.898291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 672/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:04:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:04:58.941027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:04:58.942619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:59.066706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a70d7-646e-4d22-8c55-97bde3af9e38 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:04:59.140408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:04:59.141078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:04:59.141360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:04:59.141630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:04:59.143272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:04:59.179299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:04:59.268128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:04:59.269631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf83d0-e65e-4068-bd92-20061b6519dc service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:04:59.288789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 668/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:04:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:03.456435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:03.457087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:03.457087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:03.458431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 673/1341] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:03.464172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250030c-c870-497f-a53f-5aa3ff7568ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:03.464671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250030c-c870-497f-a53f-5aa3ff7568ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:03.464774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250030c-c870-497f-a53f-5aa3ff7568ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:03.543456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f250030c-c870-497f-a53f-5aa3ff7568ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:03.544693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f250030c-c870-497f-a53f-5aa3ff7568ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:03.637122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:03.651392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 669/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:03.690102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:03.692530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:03.790396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8104-d9b9-42e5-9ac8-680715aa6dca None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:03.794361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:03.795035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:03.795312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:03.795583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:03.804743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:03.806276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc620a3e-3f12-43d5-b085-f8717e541798 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:03.815545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 674/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:06.528989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:06.529590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:06.529590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:06.530942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 670/1344] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:06.537058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5482-ac7f-428d-a424-8296875d2b82 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:06.537611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5482-ac7f-428d-a424-8296875d2b82 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:06.537611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5482-ac7f-428d-a424-8296875d2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:06.567949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-677b5482-ac7f-428d-a424-8296875d2b82 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:06.569218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-677b5482-ac7f-428d-a424-8296875d2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:06.600527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:06.655963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 675/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:06.693158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:06.695014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:06.709193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d1a59-f4f9-4518-bf84-aae4f9d9966f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:06.712964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:06.713610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:06.713886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:06.714158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:06.723395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:06.724877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5aaf0-4bf5-49d6-96bb-60a93a8a3786 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:06.734743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 671/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:10.699862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875c4a-6137-43bf-80e3-366ce17535bc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:10.700735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875c4a-6137-43bf-80e3-366ce17535bc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:10.701040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46875c4a-6137-43bf-80e3-366ce17535bc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:10.702449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 676/1347] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:10.708174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79b44-e089-44af-b5c5-3160d7782fff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:10.708605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79b44-e089-44af-b5c5-3160d7782fff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:10.708875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb79b44-e089-44af-b5c5-3160d7782fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:10.729165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0bb79b44-e089-44af-b5c5-3160d7782fff None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:10.730360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0bb79b44-e089-44af-b5c5-3160d7782fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:10.738422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 672/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:05:10.775714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46875c4a-6137-43bf-80e3-366ce17535bc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:10.788100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46875c4a-6137-43bf-80e3-366ce17535bc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:10.791804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:10.792603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:10.792944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:10.793280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:10.802533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:10.804092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986380-f0bc-4472-829e-473f36e2cba4 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:10.814135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 677/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:05:15.733701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a722e-df74-4a79-8a6c-1e5b3a554d44 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:15.734604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a722e-df74-4a79-8a6c-1e5b3a554d44 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:15.735095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a722e-df74-4a79-8a6c-1e5b3a554d44 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:15.738174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 673/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:15.744093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723835-af5f-4713-bf78-8c8d3f0dcc47 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:15.744902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723835-af5f-4713-bf78-8c8d3f0dcc47 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:15.745376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef723835-af5f-4713-bf78-8c8d3f0dcc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:15.830256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ef723835-af5f-4713-bf78-8c8d3f0dcc47 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:15.831515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ef723835-af5f-4713-bf78-8c8d3f0dcc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:15.922533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 678/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:19.996800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811251bb-a1a0-43e1-b179-9bcb1239d792 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:19.997378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811251bb-a1a0-43e1-b179-9bcb1239d792 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:19.997378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811251bb-a1a0-43e1-b179-9bcb1239d792 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:19.998926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 674/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:20.003778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a9e9-ecc9-43f1-beb5-4597f558c709 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:20.004350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a9e9-ecc9-43f1-beb5-4597f558c709 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:20.004350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a9e9-ecc9-43f1-beb5-4597f558c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:20.023413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f389a9e9-ecc9-43f1-beb5-4597f558c709 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:20.024799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f389a9e9-ecc9-43f1-beb5-4597f558c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:20.036911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 679/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:20.722961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=13 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:21.562397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683853b-6682-44fe-9eca-3be9c546ee08 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:21.563045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683853b-6682-44fe-9eca-3be9c546ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:21.563045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683853b-6682-44fe-9eca-3be9c546ee08 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:21.564348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 675/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:21.569433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f457-ab69-4d8f-be56-c2c9c3a35d6c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:21.569872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f457-ab69-4d8f-be56-c2c9c3a35d6c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:21.569982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969f457-ab69-4d8f-be56-c2c9c3a35d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:21.589681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1969f457-ab69-4d8f-be56-c2c9c3a35d6c None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:21.590888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1969f457-ab69-4d8f-be56-c2c9c3a35d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:21.600375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 680/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:25.277424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd3b-6ca5-405d-8a14-ca3a00240033 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:25.277981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd3b-6ca5-405d-8a14-ca3a00240033 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:25.277981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdcd3b-6ca5-405d-8a14-ca3a00240033 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:25.279437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 676/1356] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:25.286140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804bf2-eee5-4d20-9067-b8775d2a5e9b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:25.286978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804bf2-eee5-4d20-9067-b8775d2a5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:25.287424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804bf2-eee5-4d20-9067-b8775d2a5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:25.308853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5f804bf2-eee5-4d20-9067-b8775d2a5e9b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:25.311487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f804bf2-eee5-4d20-9067-b8775d2a5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:25.327617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 681/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:25.378255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25fea6-c523-4197-b74b-643861a0d640 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:25.378871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25fea6-c523-4197-b74b-643861a0d640 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:25.379418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25fea6-c523-4197-b74b-643861a0d640 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:25.382081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 677/1358] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 5 16:05:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:25.392144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8cd5-febf-495d-91f1-d54058228006 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:25.392550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8cd5-febf-495d-91f1-d54058228006 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:25.392847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f8cd5-febf-495d-91f1-d54058228006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:25.441391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:25.451926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e85f8cd5-febf-495d-91f1-d54058228006 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:25.453274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e85f8cd5-febf-495d-91f1-d54058228006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:25.544933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 682/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 5 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:25.560044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25fea6-c523-4197-b74b-643861a0d640 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:25.580987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25fea6-c523-4197-b74b-643861a0d640 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:25.586635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:25.587292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:25.587777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:25.588222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:25.597181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:25.598972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9abf6-95fa-44d4-a7d0-0e6775283620 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:25.610177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 678/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:27.813659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693014-0c7c-4214-9ef6-83105e4cc199 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:27.814223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693014-0c7c-4214-9ef6-83105e4cc199 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:27.814223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693014-0c7c-4214-9ef6-83105e4cc199 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:27.815976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 683/1361] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:27.822448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4f16-27e6-4f1b-9e46-f4d173696a90 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:27.822973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4f16-27e6-4f1b-9e46-f4d173696a90 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:27.822973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4f16-27e6-4f1b-9e46-f4d173696a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:27.842203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d3af4f16-27e6-4f1b-9e46-f4d173696a90 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:27.843576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d3af4f16-27e6-4f1b-9e46-f4d173696a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:27.855385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 679/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:27.899405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be693014-0c7c-4214-9ef6-83105e4cc199 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:27.914074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be693014-0c7c-4214-9ef6-83105e4cc199 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:27.919639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:27.920283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:27.920598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:27.920878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:27.929358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:27.930975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e62c3-6662-452c-b00b-35f85c3ed517 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:27.940796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 684/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:30.300185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d23c-e036-4db5-ad06-f14ec97b974d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:30.333221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d23c-e036-4db5-ad06-f14ec97b974d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:30.333221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d23c-e036-4db5-ad06-f14ec97b974d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:30.333221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 680/1364] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:30.334053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a3bb-538f-43bb-a038-fa482d8407e4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:30.334053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a3bb-538f-43bb-a038-fa482d8407e4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:30.334053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a3bb-538f-43bb-a038-fa482d8407e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:30.373527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fcf7a3bb-538f-43bb-a038-fa482d8407e4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:30.374747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fcf7a3bb-538f-43bb-a038-fa482d8407e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:30.388784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 685/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:30.432411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a133-a967-4c1b-ace7-cd8a1ce34639 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:30.432648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a133-a967-4c1b-ace7-cd8a1ce34639 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:30.432927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a133-a967-4c1b-ace7-cd8a1ce34639 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:30.434355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 681/1366] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 5 16:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:30.440229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434016-31ed-43c5-a434-18a0392e2b74 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:30.440546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434016-31ed-43c5-a434-18a0392e2b74 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:30.440826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434016-31ed-43c5-a434-18a0392e2b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:30.460285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-11434016-31ed-43c5-a434-18a0392e2b74 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:30.461578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-11434016-31ed-43c5-a434-18a0392e2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:30.476720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 686/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 5 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:05:30.485177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a133-a967-4c1b-ace7-cd8a1ce34639 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:30.501328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a133-a967-4c1b-ace7-cd8a1ce34639 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:30.506868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:30.507542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:30.507858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:30.508137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:30.516971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:30.518690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92770f-139b-46cd-a20d-011d6cf8c7ff service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:30.528846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 682/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:32.579692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e70-6d5b-43dd-89d4-406102506790 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:32.580334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e70-6d5b-43dd-89d4-406102506790 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:32.580334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4e70-6d5b-43dd-89d4-406102506790 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:32.582046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 687/1369] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:32.587229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa22b9-57c1-46a9-a513-59c246283fdb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:32.588045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa22b9-57c1-46a9-a513-59c246283fdb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:32.588543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa22b9-57c1-46a9-a513-59c246283fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:32.607550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-45fa22b9-57c1-46a9-a513-59c246283fdb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:32.609052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-45fa22b9-57c1-46a9-a513-59c246283fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:32.617827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 683/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:32.663822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4e70-6d5b-43dd-89d4-406102506790 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:32.678895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4e70-6d5b-43dd-89d4-406102506790 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:32.684656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:32.685526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:32.685988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:32.686453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:32.695013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:32.696925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef303e-f1f8-4cd1-949e-e934d86e1df8 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:32.707353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 688/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:33.313888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e11e3-3d91-459b-948a-88202a26bd45 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:33.314127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e11e3-3d91-459b-948a-88202a26bd45 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:33.314400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e11e3-3d91-459b-948a-88202a26bd45 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:33.316070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 684/1372] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:33.321578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09087-78b7-440b-9541-cb5c66468ef9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:33.321875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09087-78b7-440b-9541-cb5c66468ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:33.322180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09087-78b7-440b-9541-cb5c66468ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:33.341292 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6bc09087-78b7-440b-9541-cb5c66468ef9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:33.342488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6bc09087-78b7-440b-9541-cb5c66468ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:33.352597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 689/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:33.690144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9d2-6b7e-435e-b3be-41cb589225c8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:33.690628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9d2-6b7e-435e-b3be-41cb589225c8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:33.690628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9d2-6b7e-435e-b3be-41cb589225c8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:33.692217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 685/1374] 10.222.0.43 () {54 vars in 963 bytes} [Tue Jul 5 16:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:33.697406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e776-255e-4471-8d2f-5b1dc4937dab None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:33.697968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e776-255e-4471-8d2f-5b1dc4937dab None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:33.697968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e776-255e-4471-8d2f-5b1dc4937dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:33.750388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f7e9e776-255e-4471-8d2f-5b1dc4937dab None None] MFA Rules not processed for user `e7854f2cdbc443eab856854d0a1c8bef`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:33.751693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f7e9e776-255e-4471-8d2f-5b1dc4937dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:33.816242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 690/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Jul 5 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:05:33.824342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be9d2-6b7e-435e-b3be-41cb589225c8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:33.835992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be9d2-6b7e-435e-b3be-41cb589225c8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:33.839832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:33.840962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:33.841478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:33.841978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:33.852823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:33.854534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c5d49-2282-4a47-b293-5a5901c308e3 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:33.865755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 686/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:34.753262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e52e0-353b-42f7-be0f-b69631811f09 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:34.753853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e52e0-353b-42f7-be0f-b69631811f09 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:34.754092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e52e0-353b-42f7-be0f-b69631811f09 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:34.755533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 691/1377] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:34.761220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4103-666c-41f1-a113-70a506a0f824 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:34.761720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4103-666c-41f1-a113-70a506a0f824 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:34.761805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4103-666c-41f1-a113-70a506a0f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:34.784279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a1ec4103-666c-41f1-a113-70a506a0f824 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:34.785545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1ec4103-666c-41f1-a113-70a506a0f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:34.793876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 687/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:34.838060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e52e0-353b-42f7-be0f-b69631811f09 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:34.853004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e52e0-353b-42f7-be0f-b69631811f09 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:34.858966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:34.859613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:34.859893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:34.860137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:34.869241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:34.870865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246dc20-a859-4adf-8187-7be02b0faca8 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:34.874941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:34.881988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 692/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:36.934011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30eda-9bba-4e54-9028-c915a6b01684 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:36.934544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30eda-9bba-4e54-9028-c915a6b01684 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:36.934544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30eda-9bba-4e54-9028-c915a6b01684 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:36.935901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 688/1380] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:36.941628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0ad9-81e9-4ff1-ac26-ad027f8e13f2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:36.942138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0ad9-81e9-4ff1-ac26-ad027f8e13f2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:36.942236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0ad9-81e9-4ff1-ac26-ad027f8e13f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:36.963920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5b5b0ad9-81e9-4ff1-ac26-ad027f8e13f2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:36.965306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b5b0ad9-81e9-4ff1-ac26-ad027f8e13f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:36.973668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 693/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:37.018245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30eda-9bba-4e54-9028-c915a6b01684 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:37.033318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30eda-9bba-4e54-9028-c915a6b01684 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:37.039757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:37.040307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:37.040738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:37.041025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:37.050171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:37.051993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4590786-ab50-4a97-90d9-560eb7570c18 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:37.063151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 689/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:39.128487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca5c-9262-44d8-8f2f-5459dd23bb0b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:39.129078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca5c-9262-44d8-8f2f-5459dd23bb0b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:39.129078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca5c-9262-44d8-8f2f-5459dd23bb0b None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:39.130441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 694/1383] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:39.136080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcf63-cf69-4428-8342-5eccfebb3a12 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:39.136958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcf63-cf69-4428-8342-5eccfebb3a12 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:39.137344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcf63-cf69-4428-8342-5eccfebb3a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:39.155901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e47fcf63-cf69-4428-8342-5eccfebb3a12 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:39.157130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e47fcf63-cf69-4428-8342-5eccfebb3a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:39.165045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 690/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:05:39.208261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ca5c-9262-44d8-8f2f-5459dd23bb0b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:39.223085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ca5c-9262-44d8-8f2f-5459dd23bb0b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:39.228570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:39.229335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:39.229714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:39.230088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:39.238790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:39.240568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909fb2c-db8f-4ad5-b3d8-310cbc7f6c6a service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:39.252249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 695/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:41.269808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d4f3-1bf7-4e22-a73c-9c7a6d6e108a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:41.270345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d4f3-1bf7-4e22-a73c-9c7a6d6e108a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:41.270345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d4f3-1bf7-4e22-a73c-9c7a6d6e108a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:41.271885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 691/1386] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:41.277481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6d33-8286-4a63-924e-833a25ec0c60 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:41.277917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6d33-8286-4a63-924e-833a25ec0c60 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:41.278025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d6d33-8286-4a63-924e-833a25ec0c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:41.296560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5d0d6d33-8286-4a63-924e-833a25ec0c60 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:41.297760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d0d6d33-8286-4a63-924e-833a25ec0c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:41.305685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 696/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:41.350414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24d4f3-1bf7-4e22-a73c-9c7a6d6e108a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:41.366298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24d4f3-1bf7-4e22-a73c-9c7a6d6e108a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:41.372252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:41.372932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:41.373238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:41.373554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:41.383018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:41.384820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b84e23-20f0-4112-a15f-fe990922318b service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:41.395427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 692/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:43.519938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d9f8-8798-434c-9374-f54799dcafcc None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:43.520561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d9f8-8798-434c-9374-f54799dcafcc None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:43.520561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d9f8-8798-434c-9374-f54799dcafcc None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:43.521970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 697/1389] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:43.527990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e98d-b6fc-4bb6-91eb-501160a873d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:43.528558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e98d-b6fc-4bb6-91eb-501160a873d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:43.528723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e98d-b6fc-4bb6-91eb-501160a873d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:43.551457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1ea5e98d-b6fc-4bb6-91eb-501160a873d4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:43.553039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ea5e98d-b6fc-4bb6-91eb-501160a873d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:43.564025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 693/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:43.611033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3d9f8-8798-434c-9374-f54799dcafcc None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:43.626671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3d9f8-8798-434c-9374-f54799dcafcc None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:43.632288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:43.633119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:43.633411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:43.633686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:43.642973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:43.645059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12399c4b-c361-4614-b03b-e793ec6a840f service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:43.658715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 698/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:45.795826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370929ca-4b01-41fc-ad9e-900db46586c7 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:45.796543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370929ca-4b01-41fc-ad9e-900db46586c7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:45.796987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370929ca-4b01-41fc-ad9e-900db46586c7 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:45.800369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 694/1392] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:45.808063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29fe2-c55c-432f-b378-4a2a9876d9b6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:45.808877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29fe2-c55c-432f-b378-4a2a9876d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:45.809548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29fe2-c55c-432f-b378-4a2a9876d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:45.839436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c1e29fe2-c55c-432f-b378-4a2a9876d9b6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:45.841694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1e29fe2-c55c-432f-b378-4a2a9876d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:45.853978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 699/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:45.907671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370929ca-4b01-41fc-ad9e-900db46586c7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:45.928703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370929ca-4b01-41fc-ad9e-900db46586c7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:45.942259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:45.943284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:45.943785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:45.944236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:45.960682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:45.963843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f513da6-39e0-4797-80e0-c1e6b599002d service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:45.979990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 695/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:48.045091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847bff-760a-4476-96ae-2cb4dd5b8dff None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.045649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847bff-760a-4476-96ae-2cb4dd5b8dff None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.045649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847bff-760a-4476-96ae-2cb4dd5b8dff None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.047147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 700/1395] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:48.052726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b216-488d-433f-a739-702ceef08315 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.053179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b216-488d-433f-a739-702ceef08315 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.053288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b216-488d-433f-a739-702ceef08315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.071633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5b08b216-488d-433f-a739-702ceef08315 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:48.072879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5b08b216-488d-433f-a739-702ceef08315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:48.082826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 696/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:05:48.126928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847bff-760a-4476-96ae-2cb4dd5b8dff None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:48.142080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847bff-760a-4476-96ae-2cb4dd5b8dff None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:48.147686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:48.148333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.148757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.149030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.157948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:48.159582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee74e9-97fe-45f2-8fa4-02423ab0f12e service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:48.169036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 701/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:48.816662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943582f-0c1a-459e-a299-fce43305f84f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.816925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943582f-0c1a-459e-a299-fce43305f84f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.817205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943582f-0c1a-459e-a299-fce43305f84f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.818654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 697/1398] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:48.824381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e5f4-3b6d-42a0-9f6f-75a9a47d66e2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.824713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e5f4-3b6d-42a0-9f6f-75a9a47d66e2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.824999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e5f4-3b6d-42a0-9f6f-75a9a47d66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.843911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-76c9e5f4-3b6d-42a0-9f6f-75a9a47d66e2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:48.845154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-76c9e5f4-3b6d-42a0-9f6f-75a9a47d66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:48.854273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 702/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:48.909485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8f65-6fdd-44f2-821f-d069031395d4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.909770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8f65-6fdd-44f2-821f-d069031395d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.910048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8f65-6fdd-44f2-821f-d069031395d4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.911406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 698/1400] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 5 16:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:48.916948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6e37-74f8-435b-98b3-1190b5ec1c99 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:48.917240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6e37-74f8-435b-98b3-1190b5ec1c99 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:48.917616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede6e37-74f8-435b-98b3-1190b5ec1c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:48.966550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2ede6e37-74f8-435b-98b3-1190b5ec1c99 None None] MFA Rules not processed for user `05b1165a25eb4467af1500b2c6199e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:48.967764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2ede6e37-74f8-435b-98b3-1190b5ec1c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:49.028060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 703/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 5 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:49.035819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8f65-6fdd-44f2-821f-d069031395d4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:49.047567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8f65-6fdd-44f2-821f-d069031395d4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:49.051445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:49.052092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:49.052377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:49.052692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:49.062227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:49.063677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792b0ce-c508-460b-b0e3-a216e7daac5c service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:49.073108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 699/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:05:49.786489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056154-1e18-4862-88a3-d69b5fd3ccee None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:49.787004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056154-1e18-4862-88a3-d69b5fd3ccee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:49.787004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056154-1e18-4862-88a3-d69b5fd3ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:49.836862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-86056154-1e18-4862-88a3-d69b5fd3ccee None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:49.838088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-86056154-1e18-4862-88a3-d69b5fd3ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:49.881416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:05:49.906922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 704/1403] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:49.946406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936820d4-290a-4372-8553-a93d1d953834 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:49.946698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936820d4-290a-4372-8553-a93d1d953834 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:49.946980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936820d4-290a-4372-8553-a93d1d953834 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:49.949017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 700/1404] 10.222.0.43 () {54 vars in 942 bytes} [Tue Jul 5 16:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:05:49.955542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d31b68-670f-4364-8a3a-2a3b22b828f4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:49.955829 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d31b68-670f-4364-8a3a-2a3b22b828f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:49.956112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d31b68-670f-4364-8a3a-2a3b22b828f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:50.006124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-49d31b68-670f-4364-8a3a-2a3b22b828f4 None None] MFA Rules not processed for user `f0eaf162fd3647a0963e00de33419559`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:50.007334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-49d31b68-670f-4364-8a3a-2a3b22b828f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:50.080119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 705/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Tue Jul 5 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:50.089743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936820d4-290a-4372-8553-a93d1d953834 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:50.104289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936820d4-290a-4372-8553-a93d1d953834 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:50.110104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:50.110751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:50.111033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:50.111306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:50.120009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:50.121735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cbcf1-7077-42dd-b295-ef5896ddbee9 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:50.129856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 701/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:05:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:05:50.214901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823ae6-4811-4be6-b4aa-69fafdfd0239 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:50.215293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823ae6-4811-4be6-b4aa-69fafdfd0239 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:50.215638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823ae6-4811-4be6-b4aa-69fafdfd0239 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:50.217245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 706/1407] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:05:50.223285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418144-ac8f-4fb3-a121-28fc6839fb5b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:50.223577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418144-ac8f-4fb3-a121-28fc6839fb5b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:50.223850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8418144-ac8f-4fb3-a121-28fc6839fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:50.244107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c8418144-ac8f-4fb3-a121-28fc6839fb5b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:05:50.245697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c8418144-ac8f-4fb3-a121-28fc6839fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:05:50.272501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 702/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:05:50.301558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca823ae6-4811-4be6-b4aa-69fafdfd0239 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:05:50.315870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca823ae6-4811-4be6-b4aa-69fafdfd0239 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:05:50.321453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:05:50.322104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:05:50.322382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:05:50.322653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:05:50.331383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:05:50.333008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ec1bf-a504-4a9f-90c4-8b0ad8358048 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:05:50.342737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 707/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:00.238840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=69 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:00.338158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=59 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:12.118348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4b89-7d1f-42cb-83ac-5a7dda191a42 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:12.119201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4b89-7d1f-42cb-83ac-5a7dda191a42 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:12.119201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4b89-7d1f-42cb-83ac-5a7dda191a42 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:12.121318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 703/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jul 5 16:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:12.128931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677f56-a480-42be-968c-8f845f5fa120 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:12.129445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677f56-a480-42be-968c-8f845f5fa120 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:12.129445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb677f56-a480-42be-968c-8f845f5fa120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:12.149059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fb677f56-a480-42be-968c-8f845f5fa120 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:12.150301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb677f56-a480-42be-968c-8f845f5fa120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:12.160340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 708/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 5 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:06:12.180503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c53f3-96a7-4c63-908f-5fcef471ef65 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:12.180989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c53f3-96a7-4c63-908f-5fcef471ef65 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:12.181385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c53f3-96a7-4c63-908f-5fcef471ef65 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:12.183900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 704/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jul 5 16:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:12.190870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11fa2-5739-46e6-bf6f-b8501122a9d8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:12.191156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11fa2-5739-46e6-bf6f-b8501122a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:12.191436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11fa2-5739-46e6-bf6f-b8501122a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:12.211306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4bd11fa2-5739-46e6-bf6f-b8501122a9d8 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:12.212488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4bd11fa2-5739-46e6-bf6f-b8501122a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:12.222276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 709/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 5 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:14.729451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d9f3-3054-4ca0-8e9b-b540aa56c197 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:14.730037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d9f3-3054-4ca0-8e9b-b540aa56c197 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:14.730037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d9f3-3054-4ca0-8e9b-b540aa56c197 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:14.732232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:14.741421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7473-3974-4d2e-a6d6-906ca156b479 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:14.741817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7473-3974-4d2e-a6d6-906ca156b479 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:14.741915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7473-3974-4d2e-a6d6-906ca156b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:14.761962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0cda7473-3974-4d2e-a6d6-906ca156b479 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:14.763173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0cda7473-3974-4d2e-a6d6-906ca156b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:14.773185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:14.820707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d9f3-3054-4ca0-8e9b-b540aa56c197 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:14.841844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d9f3-3054-4ca0-8e9b-b540aa56c197 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:14.848099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:14.848778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:14.849067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:14.849342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:14.857834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:14.859436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076d12e-be9e-4247-82f1-7525606fb1b5 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:14.869051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 706/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:15.772784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86bb9-4f8c-4edb-bd87-6409228d6ad0 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:15.773690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86bb9-4f8c-4edb-bd87-6409228d6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:15.773690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86bb9-4f8c-4edb-bd87-6409228d6ad0 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:15.775341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:15.780605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5e98-efd6-468f-b9a2-fce0600f215d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:15.781078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5e98-efd6-468f-b9a2-fce0600f215d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:15.781205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5e98-efd6-468f-b9a2-fce0600f215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:15.800497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-60bc5e98-efd6-468f-b9a2-fce0600f215d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:15.801683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60bc5e98-efd6-468f-b9a2-fce0600f215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:15.810147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:15.958411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86bb9-4f8c-4edb-bd87-6409228d6ad0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:15.981620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86bb9-4f8c-4edb-bd87-6409228d6ad0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:15.987569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:15.988197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:15.988500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:15.988779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:15.997094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:15.998677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243096a-e8b2-4241-9fcd-7c63ce4cae66 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:16.008065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 712/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:16.883717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e2b9-455b-4d98-98c0-6d5b1f03195b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:16.884324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e2b9-455b-4d98-98c0-6d5b1f03195b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:16.884324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e2b9-455b-4d98-98c0-6d5b1f03195b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:16.885694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:16.890865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaaacb-c76f-4564-8cbc-bb2e7f1005c3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:16.891307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaaacb-c76f-4564-8cbc-bb2e7f1005c3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:16.891416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaaacb-c76f-4564-8cbc-bb2e7f1005c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:16.910351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7efaaacb-c76f-4564-8cbc-bb2e7f1005c3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:16.911554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7efaaacb-c76f-4564-8cbc-bb2e7f1005c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:16.920791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:17.069546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e2b9-455b-4d98-98c0-6d5b1f03195b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:17.093099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e2b9-455b-4d98-98c0-6d5b1f03195b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:17.099192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:17.099839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:17.100129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:17.100412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:17.109293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:17.110917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e34ff7-75b0-48f8-8c61-e2dc5a28dc4e service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:17.120981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 709/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:17.969591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3dffb-0d47-48b1-a3f0-0836a703ebf3 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:17.970501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3dffb-0d47-48b1-a3f0-0836a703ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:17.970501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3dffb-0d47-48b1-a3f0-0836a703ebf3 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:17.972706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:17.981057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604a429-0f5b-4a34-ad46-8364a59bb337 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:17.981486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604a429-0f5b-4a34-ad46-8364a59bb337 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:17.981629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604a429-0f5b-4a34-ad46-8364a59bb337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:18.005710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7604a429-0f5b-4a34-ad46-8364a59bb337 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:18.006927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7604a429-0f5b-4a34-ad46-8364a59bb337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:18.016427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:18.175229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3dffb-0d47-48b1-a3f0-0836a703ebf3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:18.200788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3dffb-0d47-48b1-a3f0-0836a703ebf3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:18.207328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:18.207979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:18.208254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:18.208562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:18.216877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:18.218498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c820d4-85c0-4ed8-b9bd-6514cc5efbb9 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:18.227992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 715/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:19.093508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1590-f840-42da-a873-25b023f4557f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:19.094423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1590-f840-42da-a873-25b023f4557f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:19.094423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d1590-f840-42da-a873-25b023f4557f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:19.096700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:19.104619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc881-82f4-4680-9548-5f85aca1a3ea None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:19.105064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc881-82f4-4680-9548-5f85aca1a3ea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:19.105161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc881-82f4-4680-9548-5f85aca1a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:19.125559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-592bc881-82f4-4680-9548-5f85aca1a3ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:19.126752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-592bc881-82f4-4680-9548-5f85aca1a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:19.136700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:19.288834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d1590-f840-42da-a873-25b023f4557f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:19.312013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d1590-f840-42da-a873-25b023f4557f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:19.318462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:19.319102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:19.319383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:19.319642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:19.328135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:19.329755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97697075-c864-4a98-a7f9-57e1735bb087 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:19.339300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 712/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:20.133513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b68d2-10a3-46bd-b62e-78d0e09ecf98 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:20.134140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b68d2-10a3-46bd-b62e-78d0e09ecf98 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:20.134140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b68d2-10a3-46bd-b62e-78d0e09ecf98 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:20.135536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:20.142808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a68ae-a150-42c2-acba-e0fa4f4d90d0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:20.143636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a68ae-a150-42c2-acba-e0fa4f4d90d0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:20.143821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a68ae-a150-42c2-acba-e0fa4f4d90d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:20.166061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9e1a68ae-a150-42c2-acba-e0fa4f4d90d0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:20.167273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9e1a68ae-a150-42c2-acba-e0fa4f4d90d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:20.176280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:20.325521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b68d2-10a3-46bd-b62e-78d0e09ecf98 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:20.349982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b68d2-10a3-46bd-b62e-78d0e09ecf98 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:20.358075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:20.358724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:20.359010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:20.359283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:20.367930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:20.369574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f912-5130-4fee-adf6-0d4a4569bac4 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:20.379479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 718/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:21.188098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064217-a068-42fd-8bcd-2b88a81d2d23 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:21.188747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064217-a068-42fd-8bcd-2b88a81d2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:21.188747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064217-a068-42fd-8bcd-2b88a81d2d23 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:21.190095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:21.196242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f729e4-81d5-428d-a86c-2c693047c325 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:21.196956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f729e4-81d5-428d-a86c-2c693047c325 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:21.197150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f729e4-81d5-428d-a86c-2c693047c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:21.218286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-98f729e4-81d5-428d-a86c-2c693047c325 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:21.219492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-98f729e4-81d5-428d-a86c-2c693047c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:21.231172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:21.384928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67064217-a068-42fd-8bcd-2b88a81d2d23 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:21.403290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67064217-a068-42fd-8bcd-2b88a81d2d23 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:21.408950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:21.409681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:21.409970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:21.410246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:21.418710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:21.420308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570dc5e-273c-4497-a2ec-66a124370b2b service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:21.429690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 715/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:22.239407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2cf0-ab63-4de6-bb92-5e44f6c2ce44 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:22.240018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2cf0-ab63-4de6-bb92-5e44f6c2ce44 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:22.240018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2cf0-ab63-4de6-bb92-5e44f6c2ce44 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:22.241396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:22.246994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7509-9c32-44d4-9e78-614348a9ba43 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:22.247790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7509-9c32-44d4-9e78-614348a9ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:22.247790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7509-9c32-44d4-9e78-614348a9ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:22.275843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b9cd7509-9c32-44d4-9e78-614348a9ba43 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:22.277092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9cd7509-9c32-44d4-9e78-614348a9ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:22.286107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:22.437324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e2cf0-ab63-4de6-bb92-5e44f6c2ce44 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:22.462739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e2cf0-ab63-4de6-bb92-5e44f6c2ce44 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:22.469558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:22.470204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:22.470488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:22.470762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:22.479446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:22.481085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef27a2-cf25-4a14-867e-9a4268bd77de service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:22.491372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 721/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:23.287829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8c73-bcdf-488d-bd72-cfa0951741c9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:23.288412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8c73-bcdf-488d-bd72-cfa0951741c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:23.288412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8c73-bcdf-488d-bd72-cfa0951741c9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:23.289866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:23.296070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72556-75e0-4008-9cf8-8fda90e9338d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:23.296528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72556-75e0-4008-9cf8-8fda90e9338d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:23.296669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72556-75e0-4008-9cf8-8fda90e9338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:23.324919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4cb72556-75e0-4008-9cf8-8fda90e9338d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:23.326127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4cb72556-75e0-4008-9cf8-8fda90e9338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:23.334719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:23.484885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc8c73-bcdf-488d-bd72-cfa0951741c9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:23.500667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc8c73-bcdf-488d-bd72-cfa0951741c9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:23.507326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:23.507982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:23.508263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:23.508574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:23.518291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:23.519908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636a1f-29f8-4e6c-84e1-0980e0f85d95 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:23.530846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 718/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:25.477467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c00-e2ca-480e-99f2-5399db09695c None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:25.478087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c00-e2ca-480e-99f2-5399db09695c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:25.478087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c00-e2ca-480e-99f2-5399db09695c None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:25.479903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:25.486436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0808-3dbe-4adb-9630-82b50ec49747 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:25.486891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0808-3dbe-4adb-9630-82b50ec49747 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:25.487002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0808-3dbe-4adb-9630-82b50ec49747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:25.506686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6bbb0808-3dbe-4adb-9630-82b50ec49747 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:25.507906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6bbb0808-3dbe-4adb-9630-82b50ec49747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:25.516415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:06:25.556275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2c00-e2ca-480e-99f2-5399db09695c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:25.575853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2c00-e2ca-480e-99f2-5399db09695c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:25.579324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:25.579973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:25.580251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:25.580560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:25.589999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:25.591429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8559-5868-49da-b92e-316a8d83011f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:25.602850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 724/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:27.785111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62adea8-e22f-495e-bfd7-39cd8bf6c440 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:27.785725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62adea8-e22f-495e-bfd7-39cd8bf6c440 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:27.785725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62adea8-e22f-495e-bfd7-39cd8bf6c440 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:27.787065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:06:27.793859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496884-94d2-450d-bbd6-af7aa03004f9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:27.794321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496884-94d2-450d-bbd6-af7aa03004f9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:27.794429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496884-94d2-450d-bbd6-af7aa03004f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:27.822781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-46496884-94d2-450d-bbd6-af7aa03004f9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:27.824284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-46496884-94d2-450d-bbd6-af7aa03004f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:27.833544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:27.871782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62adea8-e22f-495e-bfd7-39cd8bf6c440 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:27.888483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62adea8-e22f-495e-bfd7-39cd8bf6c440 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:27.892867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:27.893495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:27.893771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:27.894040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:27.903359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:27.904845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65993cd-1dff-4617-a4d9-f815352398d2 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:27.914266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 721/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:30.298099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710786-35fc-4186-9d06-71c1225e6f73 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:30.298828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710786-35fc-4186-9d06-71c1225e6f73 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:30.298828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710786-35fc-4186-9d06-71c1225e6f73 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:30.300082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:06:30.306997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2cf7-1a13-4fc2-b2b2-0a390b024a99 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:30.307730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2cf7-1a13-4fc2-b2b2-0a390b024a99 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:30.307939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2cf7-1a13-4fc2-b2b2-0a390b024a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:30.338248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aaef2cf7-1a13-4fc2-b2b2-0a390b024a99 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:30.339986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aaef2cf7-1a13-4fc2-b2b2-0a390b024a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:30.353458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:30.396099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710786-35fc-4186-9d06-71c1225e6f73 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:30.410412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710786-35fc-4186-9d06-71c1225e6f73 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:30.414290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:30.414936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:30.415220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:30.415496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:30.424828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:30.426275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1d109-89ac-4c44-8234-f55a2ab93cdf service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:30.436267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 727/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:32.629706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756242c-4b68-4ff9-b61a-ff38e1d855bd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:32.630635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756242c-4b68-4ff9-b61a-ff38e1d855bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:32.630635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756242c-4b68-4ff9-b61a-ff38e1d855bd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:32.632912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:32.638593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce45ea-d24d-4b56-9780-6f1b07849b09 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:32.639035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce45ea-d24d-4b56-9780-6f1b07849b09 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:32.639140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce45ea-d24d-4b56-9780-6f1b07849b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:32.657677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b5ce45ea-d24d-4b56-9780-6f1b07849b09 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:32.658863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b5ce45ea-d24d-4b56-9780-6f1b07849b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:32.667258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:32.706027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756242c-4b68-4ff9-b61a-ff38e1d855bd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:32.718994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756242c-4b68-4ff9-b61a-ff38e1d855bd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:32.723746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:32.724388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:32.724707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:32.724980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:32.734333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:32.735712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f66ff-1603-47e6-a168-4b03ddfdc4c3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:32.745059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 724/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:34.817768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca4b2-ca19-4ae8-a978-f34b2081fee4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:34.818365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca4b2-ca19-4ae8-a978-f34b2081fee4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:34.818365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca4b2-ca19-4ae8-a978-f34b2081fee4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:34.819721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:34.826766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34e8-2217-4f09-9782-edd3b6775e85 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:34.827483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34e8-2217-4f09-9782-edd3b6775e85 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:34.827635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34e8-2217-4f09-9782-edd3b6775e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:34.856628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cffd34e8-2217-4f09-9782-edd3b6775e85 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:34.857830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cffd34e8-2217-4f09-9782-edd3b6775e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:34.867224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:34.906280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eca4b2-ca19-4ae8-a978-f34b2081fee4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:34.923003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eca4b2-ca19-4ae8-a978-f34b2081fee4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:34.928478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:34.929414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:34.929691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:34.929963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:34.940396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:34.941862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527860f-7a2c-4c71-853f-359dfb61f15a service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:34.951768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 730/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:37.026817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3651c8-c8d0-4c8d-9bc6-713f5b2aac1f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:37.027357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3651c8-c8d0-4c8d-9bc6-713f5b2aac1f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:37.027357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3651c8-c8d0-4c8d-9bc6-713f5b2aac1f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:37.029517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:37.037204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208476d-1092-4fec-84e2-818a4d02e0f0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:37.037615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208476d-1092-4fec-84e2-818a4d02e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:37.037767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208476d-1092-4fec-84e2-818a4d02e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:37.056665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3208476d-1092-4fec-84e2-818a4d02e0f0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:37.057882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3208476d-1092-4fec-84e2-818a4d02e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:37.066545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:37.104415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3651c8-c8d0-4c8d-9bc6-713f5b2aac1f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:37.116671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3651c8-c8d0-4c8d-9bc6-713f5b2aac1f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:37.120368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:37.121058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:37.121312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:37.121584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:37.131956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:37.133438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392f045-00f6-429f-be92-91c5e6c1e5b0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:37.143185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 727/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:39.219710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a7ed-951c-4a19-87b3-4d03744909f8 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:39.220348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a7ed-951c-4a19-87b3-4d03744909f8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:39.220348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a7ed-951c-4a19-87b3-4d03744909f8 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:39.221690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:39.228419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80819-7b4a-4801-8a6a-7c99fee12fbc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:39.228919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80819-7b4a-4801-8a6a-7c99fee12fbc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:39.229042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a80819-7b4a-4801-8a6a-7c99fee12fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:39.248120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-75a80819-7b4a-4801-8a6a-7c99fee12fbc None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:39.249448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-75a80819-7b4a-4801-8a6a-7c99fee12fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:39.260510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:39.300095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a7ed-951c-4a19-87b3-4d03744909f8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:39.318545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a7ed-951c-4a19-87b3-4d03744909f8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:39.324526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:39.325172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:39.325448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:39.325718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:39.335639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:39.337139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977e592-ad21-41fd-853a-fceaedc09c1f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:39.347002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 733/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:41.401511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b887-fbb7-43ad-9090-4ec36b33ef54 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:41.402107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b887-fbb7-43ad-9090-4ec36b33ef54 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:41.402107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b887-fbb7-43ad-9090-4ec36b33ef54 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:41.403465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:41.412658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fafc0-ee28-453b-a598-17ecb33dd858 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:41.413139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fafc0-ee28-453b-a598-17ecb33dd858 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:41.413332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fafc0-ee28-453b-a598-17ecb33dd858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:41.421019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=79 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:41.435492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5b2fafc0-ee28-453b-a598-17ecb33dd858 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:41.436740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5b2fafc0-ee28-453b-a598-17ecb33dd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:41.445212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:41.482912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426b887-fbb7-43ad-9090-4ec36b33ef54 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:41.489111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=73 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:41.496068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426b887-fbb7-43ad-9090-4ec36b33ef54 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:41.499751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:41.500398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:41.500718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:41.500996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:41.510135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:41.511581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ec219-f59a-4910-bf53-d5b8686549ef service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:41.521144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 730/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:43.531649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ef04-61b3-480e-85a8-3f1ca3c0a36e None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:43.532599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ef04-61b3-480e-85a8-3f1ca3c0a36e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:43.532599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ef04-61b3-480e-85a8-3f1ca3c0a36e None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:43.534719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:43.543387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab34ba-3a48-4642-976f-5322e0edc60b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:43.543835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab34ba-3a48-4642-976f-5322e0edc60b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:43.543974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab34ba-3a48-4642-976f-5322e0edc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:43.571349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-01ab34ba-3a48-4642-976f-5322e0edc60b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:43.573052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-01ab34ba-3a48-4642-976f-5322e0edc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:43.582472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:43.618697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ef04-61b3-480e-85a8-3f1ca3c0a36e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:43.630960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ef04-61b3-480e-85a8-3f1ca3c0a36e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:43.634968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:43.635609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:43.635885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:43.636157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:43.645386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:43.646826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882da5-dbcb-45c7-8d53-6abb2abb65ff service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:43.656225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 736/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:45.693010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f37-b5dc-47ac-97c1-998218e90ad2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:45.693937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f37-b5dc-47ac-97c1-998218e90ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:45.693937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3f37-b5dc-47ac-97c1-998218e90ad2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:45.696146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:06:45.705126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531ef4-1953-4581-9e66-42052ff208c4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:45.705555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531ef4-1953-4581-9e66-42052ff208c4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:45.705784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531ef4-1953-4581-9e66-42052ff208c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:45.727200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-da531ef4-1953-4581-9e66-42052ff208c4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:06:45.728409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-da531ef4-1953-4581-9e66-42052ff208c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:06:45.737799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:06:45.778154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3f37-b5dc-47ac-97c1-998218e90ad2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:06:45.794769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3f37-b5dc-47ac-97c1-998218e90ad2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:06:45.799159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:06:45.799826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:06:45.800092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:06:45.800383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:06:45.809892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:06:45.811343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783406cc-daa5-4aa9-928f-12388d2d651d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:06:45.820986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 733/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:06:55.721873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=11 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:55.816654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=14 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:07:05.492065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43445ad-565a-4fad-885c-8e9562a3d0f7 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:05.492644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43445ad-565a-4fad-885c-8e9562a3d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:05.492644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43445ad-565a-4fad-885c-8e9562a3d0f7 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:05.494782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 738/1471] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:05.500981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00420fd-e219-452c-8f67-6d49097aba81 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:05.501428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00420fd-e219-452c-8f67-6d49097aba81 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:05.501544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00420fd-e219-452c-8f67-6d49097aba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:05.520619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c00420fd-e219-452c-8f67-6d49097aba81 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:05.521798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c00420fd-e219-452c-8f67-6d49097aba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:05.530086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 734/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:05.618160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321582d-cf72-499a-b00e-0eec8556758a None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:05.618453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321582d-cf72-499a-b00e-0eec8556758a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:05.618734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321582d-cf72-499a-b00e-0eec8556758a None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:05.620110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 739/1473] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 5 16:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:05.625419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7693-fe14-41e7-8f43-171c75c07f0f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:05.625702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7693-fe14-41e7-8f43-171c75c07f0f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:05.625961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7693-fe14-41e7-8f43-171c75c07f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:05.644820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6a6d7693-fe14-41e7-8f43-171c75c07f0f None None] MFA Rules not processed for user `05b1165a25eb4467af1500b2c6199e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:05.646025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a6d7693-fe14-41e7-8f43-171c75c07f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:05.655494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 735/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 5 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:05.666766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321582d-cf72-499a-b00e-0eec8556758a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:05.683029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321582d-cf72-499a-b00e-0eec8556758a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:05.687328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:05.687960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:05.688222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:05.688528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:05.697621 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:05.699433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8c49-6515-473f-9b33-a3b049757a54 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:05.709025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 740/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:07:07.801687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0d8e-c812-427c-92f8-8269a5478440 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:07.802572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0d8e-c812-427c-92f8-8269a5478440 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:07.802572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0d8e-c812-427c-92f8-8269a5478440 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:07.804917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 736/1476] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:07.811332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317a9d-4b8a-45e8-b5fa-cf51099c5d29 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:07.811806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317a9d-4b8a-45e8-b5fa-cf51099c5d29 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:07.811912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317a9d-4b8a-45e8-b5fa-cf51099c5d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:07.834490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f4317a9d-4b8a-45e8-b5fa-cf51099c5d29 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:07.835705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f4317a9d-4b8a-45e8-b5fa-cf51099c5d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:07.844908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 741/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:07.869238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0d8e-c812-427c-92f8-8269a5478440 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:07.888697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0d8e-c812-427c-92f8-8269a5478440 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:07.893538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:07.894194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:07.894475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:07.894745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:07.895480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:07.897304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:07:07.897304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:07:07.897304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:07:07.898459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094607b-628a-4699-9feb-5806d014df25 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:07.918316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 737/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 5 16:07:07 2022] GET /identity/v3/projects => generated 2553 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:07:09.945245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be38c0-c6ea-45e8-bc25-7a8ff4821001 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:09.945843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be38c0-c6ea-45e8-bc25-7a8ff4821001 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:09.945843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be38c0-c6ea-45e8-bc25-7a8ff4821001 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:09.947283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 742/1479] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:09.954123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c4d35-84ef-4ae4-9f00-6dabe32ddbc5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:09.954593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c4d35-84ef-4ae4-9f00-6dabe32ddbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:09.954696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c4d35-84ef-4ae4-9f00-6dabe32ddbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:09.982085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0a5c4d35-84ef-4ae4-9f00-6dabe32ddbc5 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:09.983293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a5c4d35-84ef-4ae4-9f00-6dabe32ddbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:09.991459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 738/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:10.033825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be38c0-c6ea-45e8-bc25-7a8ff4821001 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:10.048981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be38c0-c6ea-45e8-bc25-7a8ff4821001 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:10.054432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:10.055071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:10.055350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:10.055652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:10.063763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:10.065372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f203a0-d5eb-4a41-aa24-4de41a487341 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:10.075556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 743/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:07:12.287481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd676c4-32b1-43ee-89e7-eb1210eea093 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:12.288117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd676c4-32b1-43ee-89e7-eb1210eea093 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:12.288117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd676c4-32b1-43ee-89e7-eb1210eea093 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:12.289463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 739/1482] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:12.295926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4d33-89a3-44b5-9c1a-152bd5d0d232 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:12.296732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4d33-89a3-44b5-9c1a-152bd5d0d232 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:12.296877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f4d33-89a3-44b5-9c1a-152bd5d0d232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:12.321570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-960f4d33-89a3-44b5-9c1a-152bd5d0d232 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:12.322773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-960f4d33-89a3-44b5-9c1a-152bd5d0d232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:12.331475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 744/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:12.370072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd676c4-32b1-43ee-89e7-eb1210eea093 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:12.385667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd676c4-32b1-43ee-89e7-eb1210eea093 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:12.390399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:12.391070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:12.391357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:12.391628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:12.401780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:12.403227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9d02-07ce-41a2-8e38-37d522aa1b9e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:12.412907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 740/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:07:14.467767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650012-a277-4457-8a1d-216e49ce4975 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:14.468520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650012-a277-4457-8a1d-216e49ce4975 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:14.468677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650012-a277-4457-8a1d-216e49ce4975 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:14.470831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 745/1485] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:14.477405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28d7d-2c5a-4ea9-9b03-a294e9d80012 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:14.477877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28d7d-2c5a-4ea9-9b03-a294e9d80012 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:14.478088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe28d7d-2c5a-4ea9-9b03-a294e9d80012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:14.497118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-abe28d7d-2c5a-4ea9-9b03-a294e9d80012 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:14.498342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-abe28d7d-2c5a-4ea9-9b03-a294e9d80012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:14.506800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 741/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:14.545235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650012-a277-4457-8a1d-216e49ce4975 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:14.563452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650012-a277-4457-8a1d-216e49ce4975 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:14.570148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:14.571098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:14.571452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:14.571729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:14.581722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:14.583174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e25166-673a-4a43-9711-631d8c0ba5e6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:14.593079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 746/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:07:16.755742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9b3a-f3cb-4c4d-a19d-c07b6d3db758 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:16.756340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9b3a-f3cb-4c4d-a19d-c07b6d3db758 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:16.756340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc9b3a-f3cb-4c4d-a19d-c07b6d3db758 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:16.757708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 742/1488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:07:16.764127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8969f-6175-4336-9057-6930aa23de01 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:16.764937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8969f-6175-4336-9057-6930aa23de01 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:16.765069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8969f-6175-4336-9057-6930aa23de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:16.793320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cae8969f-6175-4336-9057-6930aa23de01 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:16.794541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cae8969f-6175-4336-9057-6930aa23de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:16.802392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 747/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:16.845845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc9b3a-f3cb-4c4d-a19d-c07b6d3db758 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:16.858423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc9b3a-f3cb-4c4d-a19d-c07b6d3db758 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:16.862372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:16.863008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:16.863289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:16.863563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:16.873268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:16.874712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0bcdf-3760-4322-bbbf-059f149fbf1a service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:16.884967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 743/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:07:19.082911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe707de-fb73-40af-9659-c0741e570127 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:19.083652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe707de-fb73-40af-9659-c0741e570127 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:19.083652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe707de-fb73-40af-9659-c0741e570127 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:19.085910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 748/1491] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 5 16:07:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:07:19.091350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781203d-f69a-489c-a4cf-d0b9c47c6e78 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:19.091839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781203d-f69a-489c-a4cf-d0b9c47c6e78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:19.091936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781203d-f69a-489c-a4cf-d0b9c47c6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:19.111171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3781203d-f69a-489c-a4cf-d0b9c47c6e78 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:07:19.112365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3781203d-f69a-489c-a4cf-d0b9c47c6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:07:19.120862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 744/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 5 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:07:19.162855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe707de-fb73-40af-9659-c0741e570127 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:07:19.176730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe707de-fb73-40af-9659-c0741e570127 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:07:19.181206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:07:19.181843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:07:19.182123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:07:19.182399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:07:19.191623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:07:19.193087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacb69b-36d3-459b-af21-0440195547ea service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:07:19.202967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 749/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:07:29.106095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=33 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:07:29.198313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=33 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:44.939369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:44.940353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:44.940353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:44.966509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:08:44.967706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:44.975928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 745/1494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:08:44.984002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:44.984543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:44.984543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.002725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:08:45.003930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:45.012559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 750/1495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:08:45.017152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.027413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929fd2-0b96-4f26-9e4c-8ba5cc0926ac None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.033713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.034370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.034652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.034922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.035640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:08:45.035946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.037009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.037009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:08:45.037009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:08:45.037971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.050431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 746/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:08:45.058435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.067625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4ea6e-6605-413d-8de0-7834de0f7678 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.073499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.074147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.074422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.074678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.075451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.077288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.077288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:08:45.077288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:08:45.078488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.117952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 751/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:08:45.122242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.132852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878a896-4a04-4212-a221-1d28fd60b698 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.205343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.205940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.206219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.206492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.207181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.208200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.208200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:08:45.208200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:08:45.209449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.231064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 747/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:08:45 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:08:45.235486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.246117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd5fa-0039-4e4e-8c45-b0f236a3a49a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.251215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.251884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.252164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.252434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.253252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.254291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.254291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:08:45.254291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:08:45.255257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.268781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 752/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:08:45.272784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.283496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f8fd3-123b-453f-a60a-6623ba0ace61 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.289561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.290230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.290518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.290789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.291511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.292571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.292571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:08:45.292571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:08:45.293460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c7325-d883-4869-9c71-bfe877a58309 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.307374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 748/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:08:45.311583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.322215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8a86a-99b6-4bf9-aba7-b11b2593a9cd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.328415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.329331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.329611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.329884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] PATH_INFO: `/v3/projects/2da211ff369b4a9894f40715c43ca52f/users/2e702c8e00ed4a358b4152ec7b735ee0/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.345767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da211ff369b4a9894f40715c43ca52f, user_id=2e702c8e00ed4a358b4152ec7b735ee0, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.346821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.346821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:08:45.346821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:08:45.348825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983add-05dd-4ad2-b054-6a5ba681528b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.363785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 753/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:08:45 2022] PUT /identity/v3/projects/2da211ff369b4a9894f40715c43ca52f/users/2e702c8e00ed4a358b4152ec7b735ee0/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:08:45.376152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83b36-e3e6-4af2-943b-f06deac7dd11 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.376469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83b36-e3e6-4af2-943b-f06deac7dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.376753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e83b36-e3e6-4af2-943b-f06deac7dd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.404171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-94e83b36-e3e6-4af2-943b-f06deac7dd11 None None] MFA Rules not processed for user `2e702c8e00ed4a358b4152ec7b735ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:08:45.405425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-94e83b36-e3e6-4af2-943b-f06deac7dd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:45.473460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 749/1502] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:08:45.486952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4fce-b117-4b3f-9530-12afea6dc580 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.487242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4fce-b117-4b3f-9530-12afea6dc580 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.487519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4fce-b117-4b3f-9530-12afea6dc580 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.488952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 754/1503] 10.222.0.43 () {54 vars in 963 bytes} [Tue Jul 5 16:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:08:45.493943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3611b0-6e07-47cd-8a22-40e5bd1f4f14 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.494238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3611b0-6e07-47cd-8a22-40e5bd1f4f14 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.494542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3611b0-6e07-47cd-8a22-40e5bd1f4f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.513270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff3611b0-6e07-47cd-8a22-40e5bd1f4f14 None None] MFA Rules not processed for user `e7854f2cdbc443eab856854d0a1c8bef`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:08:45.514445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff3611b0-6e07-47cd-8a22-40e5bd1f4f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:45.560947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:45.572361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 750/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Jul 5 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:08:45.580734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4fce-b117-4b3f-9530-12afea6dc580 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.591699 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4fce-b117-4b3f-9530-12afea6dc580 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.595688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.596144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.596429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.596743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.606582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.608064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.616934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 755/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:08:45.659300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198939-a67c-47d5-8cf5-2898b611ca6a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.659584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198939-a67c-47d5-8cf5-2898b611ca6a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.659859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf198939-a67c-47d5-8cf5-2898b611ca6a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.661206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 751/1506] 10.222.0.43 () {52 vars in 829 bytes} [Tue Jul 5 16:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:08:45.664832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.727365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75d585-f30f-415b-af38-27057224e073 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:45.733135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:45.734023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.734302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.734571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] PATH_INFO: `/v3/users/2e702c8e00ed4a358b4152ec7b735ee0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.735931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e702c8e00ed4a358b4152ec7b735ee0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:45.737018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:45.737018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:08:45.737018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:08:45.738220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:45.804114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e702c8e00ed4a358b4152ec7b735ee0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:45.804877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e702c8e00ed4a358b4152ec7b735ee0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:45.805489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e702c8e00ed4a358b4152ec7b735ee0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:45.819008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e702c8e00ed4a358b4152ec7b735ee0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:45.831399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e702c8e00ed4a358b4152ec7b735ee0'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:45.847717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:45.857756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 756/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:08:45 2022] DELETE /identity/v3/users/2e702c8e00ed4a358b4152ec7b735ee0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:08:45.862379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:45.862717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:45.862992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:45.880778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:08:45.882673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:45.952842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 752/1508] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:08:45.965608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:45.967172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:46.033184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c20-4ffd-4d91-8ee9-0bec25cfcf5d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:46.038710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:46.039366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:46.039647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:46.039920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:46.049981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:46.051425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468fedc-59b9-4560-99ac-f14b5595ab45 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:46.061352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 757/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:08:46.410460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:08:46.411903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:08:46.423586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19061-de38-4c24-ba68-76a9ca403d54 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:08:46.428266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:08:46.429225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:08:46.429510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:08:46.429798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] PATH_INFO: `/v3/projects/2da211ff369b4a9894f40715c43ca52f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:08:46.431005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da211ff369b4a9894f40715c43ca52f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:08:46.432037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:08:46.432037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:08:46.432037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:08:46.433274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:08:46.501121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da211ff369b4a9894f40715c43ca52f', 'request_id': 'req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:46.507847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da211ff369b4a9894f40715c43ca52f', 'request_id': 'req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:46.519091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da211ff369b4a9894f40715c43ca52f', 'request_id': 'req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:46.537130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] The token cache is being invalidate because project 2da211ff369b4a9894f40715c43ca52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:08:46.537471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:46.538200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7ba6c57e-8b86-4b5d-b240-98e643a1efbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:08:46.539791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 753/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:08:46 2022] DELETE /identity/v3/projects/2da211ff369b4a9894f40715c43ca52f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:08:56.056851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:56.534125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:30.061809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:30.062428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:30.062428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:30.064022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:30.069258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ab53a-59eb-46ab-90ef-6cfb3a2b2311 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:30.069716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ab53a-59eb-46ab-90ef-6cfb3a2b2311 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:30.069815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ab53a-59eb-46ab-90ef-6cfb3a2b2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:30.090452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-698ab53a-59eb-46ab-90ef-6cfb3a2b2311 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:30.091649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-698ab53a-59eb-46ab-90ef-6cfb3a2b2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:30.154400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:30.308989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:30.311798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:30.393876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b78b1-9f19-4457-b0bd-5d7b95dd28e5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:30.399714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:30.400367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:30.400692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:30.400963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:30.409890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:30.411493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078183-3ae8-451a-b7e6-9712a8ae4cb2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:30.421299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 759/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:31.244668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc98f99-2e51-40f8-8d53-393cdcc93a02 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:31.245280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc98f99-2e51-40f8-8d53-393cdcc93a02 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:31.245280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc98f99-2e51-40f8-8d53-393cdcc93a02 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:31.247396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:10:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:31.253862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b23b-e24f-4c8d-b44f-6f894376e542 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:31.254270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b23b-e24f-4c8d-b44f-6f894376e542 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:31.254376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b23b-e24f-4c8d-b44f-6f894376e542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:31.273814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2fb7b23b-e24f-4c8d-b44f-6f894376e542 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:31.275018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2fb7b23b-e24f-4c8d-b44f-6f894376e542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:31.283757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:31.434435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc98f99-2e51-40f8-8d53-393cdcc93a02 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:31.451108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc98f99-2e51-40f8-8d53-393cdcc93a02 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:31.457427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:31.458063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:31.458340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:31.458611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:31.466958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:31.468608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f099-cff3-4fe5-a713-677e925f65c4 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:31.478412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 756/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:31.992404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c875-1e36-4d34-a965-578d0232695b None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:31.992650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c875-1e36-4d34-a965-578d0232695b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:31.992910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c875-1e36-4d34-a965-578d0232695b None None] PATH_INFO: `/v3` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:31.994249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 761/1517] 10.222.0.20 () {54 vars in 925 bytes} [Tue Jul 5 16:10:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:10:32.001706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19221e2-38b0-48db-a8c2-df3b88172990 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:32.001971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19221e2-38b0-48db-a8c2-df3b88172990 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:32.002402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19221e2-38b0-48db-a8c2-df3b88172990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:32.022947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e19221e2-38b0-48db-a8c2-df3b88172990 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:32.024157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e19221e2-38b0-48db-a8c2-df3b88172990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:32.088347 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 757/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 5 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:41.119315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff31c5-a67e-4ebd-a651-4570c7271894 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:41.119895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff31c5-a67e-4ebd-a651-4570c7271894 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:41.119895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff31c5-a67e-4ebd-a651-4570c7271894 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:41.121143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 762/1519] 10.222.0.43 () {54 vars in 960 bytes} [Tue Jul 5 16:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:41.126316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27750f5-7e99-40c8-b304-7a461e9fcd72 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:41.126774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27750f5-7e99-40c8-b304-7a461e9fcd72 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:41.126902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27750f5-7e99-40c8-b304-7a461e9fcd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:41.146670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e27750f5-7e99-40c8-b304-7a461e9fcd72 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:41.147850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e27750f5-7e99-40c8-b304-7a461e9fcd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:41.157631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 758/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Jul 5 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:41.165006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff31c5-a67e-4ebd-a651-4570c7271894 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:41.184972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff31c5-a67e-4ebd-a651-4570c7271894 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:41.192943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:41.193574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:41.193825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:41.194099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:41.203156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:41.204813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8e6b0-a295-4f67-8cb4-7402e6316910 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:41.214379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 763/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:42.726081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fddd-9bf7-4446-818e-49e9a17ea7eb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:42.727007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fddd-9bf7-4446-818e-49e9a17ea7eb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:42.727007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fddd-9bf7-4446-818e-49e9a17ea7eb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:42.729195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:42.735233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4b74-0c8b-4b06-bc19-89e7b8c4930a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:42.735661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4b74-0c8b-4b06-bc19-89e7b8c4930a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:42.735756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4b74-0c8b-4b06-bc19-89e7b8c4930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:42.755735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab0c4b74-0c8b-4b06-bc19-89e7b8c4930a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:42.756971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab0c4b74-0c8b-4b06-bc19-89e7b8c4930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:42.766017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:42.920516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3fddd-9bf7-4446-818e-49e9a17ea7eb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:42.938259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3fddd-9bf7-4446-818e-49e9a17ea7eb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:42.944686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:42.945333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:42.945615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:42.946259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:42.955129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:42.957238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92991-1833-4e9f-a1ec-0bd61bf038fa service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:42.967201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 760/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:43.787097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f703f14-f7e6-4785-b8bf-93d3cae6d131 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:43.787926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f703f14-f7e6-4785-b8bf-93d3cae6d131 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:43.787926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f703f14-f7e6-4785-b8bf-93d3cae6d131 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:43.790318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 16:10:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:43.798324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616ff2-3e27-469f-a17b-d9356669ceb9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:43.798802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616ff2-3e27-469f-a17b-d9356669ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:43.798907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616ff2-3e27-469f-a17b-d9356669ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:43.818533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9c616ff2-3e27-469f-a17b-d9356669ceb9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:43.819733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c616ff2-3e27-469f-a17b-d9356669ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:43.829493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:43.981404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f703f14-f7e6-4785-b8bf-93d3cae6d131 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:43.998173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f703f14-f7e6-4785-b8bf-93d3cae6d131 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:44.004842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:44.005485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:44.005760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:44.006030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:44.014274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:44.015865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f126e4-628b-4177-a66c-09f3d9c087e5 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:44.025406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 766/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:48.009149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:48.010080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:48.010080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:48.012217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:48.020622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e3dc-bfba-4591-924b-7596cdd3a3d0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:48.021094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e3dc-bfba-4591-924b-7596cdd3a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:48.021229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e3dc-bfba-4591-924b-7596cdd3a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:48.040259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8447e3dc-bfba-4591-924b-7596cdd3a3d0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:48.041489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8447e3dc-bfba-4591-924b-7596cdd3a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:48.050377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:48.127399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:48.130216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:48.196301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0de6-ca63-4d57-b588-5284319b35bf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:48.200708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:48.201350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:48.201627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:48.201899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:48.211222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:48.212718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e0761-63d5-44be-9a0d-cde2fb6bd630 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:48.218028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:48.222973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 763/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:50.231783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec595f6-19da-4ec8-accf-933a3fa15606 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:50.232689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec595f6-19da-4ec8-accf-933a3fa15606 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:50.232689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec595f6-19da-4ec8-accf-933a3fa15606 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:50.235020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:50.240460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2e2d-e6c7-468d-878b-cfac0c9c7251 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:50.240938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2e2d-e6c7-468d-878b-cfac0c9c7251 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:50.241035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2e2d-e6c7-468d-878b-cfac0c9c7251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:50.259936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-db3b2e2d-e6c7-468d-878b-cfac0c9c7251 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:50.261203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-db3b2e2d-e6c7-468d-878b-cfac0c9c7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:50.269215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:50.319155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec595f6-19da-4ec8-accf-933a3fa15606 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:50.336188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec595f6-19da-4ec8-accf-933a3fa15606 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:50.340695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:50.341341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:50.341633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:50.341891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:50.351338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:50.352863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d74937-2845-4984-8a83-548a8520339d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:50.362468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 769/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:53.852639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:53.853537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:53.853537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:53.855909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:53.862145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452744f9-430d-426f-8057-e2ef0b571486 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:53.862587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452744f9-430d-426f-8057-e2ef0b571486 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:53.862706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452744f9-430d-426f-8057-e2ef0b571486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:53.884714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-452744f9-430d-426f-8057-e2ef0b571486 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:53.885896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-452744f9-430d-426f-8057-e2ef0b571486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:53.894183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:54.197914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:54.200932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:54.266492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a4bfe-9e9f-4199-a0f7-8f7380dd403b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:54.270809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:54.271442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:54.271716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:54.271985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:54.282054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:54.283611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7882af-2c1f-4d22-a8f0-b6ade9ed551d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:54.293840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 766/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:10:56.343248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:56.344132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:56.344132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:56.346392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 16:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:10:56.355059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc807-496d-46c9-af77-f7e7395b51ec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:56.355477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc807-496d-46c9-af77-f7e7395b51ec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:56.355666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc807-496d-46c9-af77-f7e7395b51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:56.378298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-928cc807-496d-46c9-af77-f7e7395b51ec None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:10:56.379510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-928cc807-496d-46c9-af77-f7e7395b51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:56.388403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 16:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:10:56.691115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:10:56.693439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:10:56.702099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=65 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:56.709135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaf63-c193-47f1-9097-915ef39fd2e2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:10:56.712803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:10:56.713456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:10:56.713741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:10:56.714022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:10:56.723168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:10:56.724639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276bb5-7eae-4e22-8e6d-67d028048225 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:10:56.734502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 772/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:11:06.373077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=32 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:06.730193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:35.370891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.371550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.371550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.395296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.396533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.411950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 768/1540] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.421407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4799c-cce4-4d8f-a3ab-7490d3834fd9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.424143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4799c-cce4-4d8f-a3ab-7490d3834fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.424143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4799c-cce4-4d8f-a3ab-7490d3834fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.448951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e5a4799c-cce4-4d8f-a3ab-7490d3834fd9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.450176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e5a4799c-cce4-4d8f-a3ab-7490d3834fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.460908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 773/1541] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.466018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.487764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50782d9-1d40-4349-b7e9-a688ae8b56b8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.491712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b013-a2a5-46c4-ab18-7d4e81394040 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.493228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b013-a2a5-46c4-ab18-7d4e81394040 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.493228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b013-a2a5-46c4-ab18-7d4e81394040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.495151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.495833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.496117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.496397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.497177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.497525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.499190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35c6dc-605a-43f9-9caf-552e194154f7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.517020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 769/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.518712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.519224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.519724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.526358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5d07b013-a2a5-46c4-ab18-7d4e81394040 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.527601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5d07b013-a2a5-46c4-ab18-7d4e81394040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.548288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 774/1543] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:35.550010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638224e-69b0-4029-ace9-b74e84a80dac None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.551178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.551965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638224e-69b0-4029-ace9-b74e84a80dac None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.553326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.554589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638224e-69b0-4029-ace9-b74e84a80dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.573149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 770/1544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.574290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.589974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4638224e-69b0-4029-ace9-b74e84a80dac None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.589974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4638224e-69b0-4029-ace9-b74e84a80dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.590291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04080f9-6e29-4dde-b858-a7b7cfc6116c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.602327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.603008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.603540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.604019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.604150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 775/1545] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.604944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.606080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f10cc-b7d4-4c93-a3c2-60b048f60fa8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.606206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:35.606206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:12:35.606206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:12:35.607028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f10cc-b7d4-4c93-a3c2-60b048f60fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.607524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f10cc-b7d4-4c93-a3c2-60b048f60fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.608486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2861-b13d-4543-832f-50f868b667cd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.628101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f91f10cc-b7d4-4c93-a3c2-60b048f60fa8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.629461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f91f10cc-b7d4-4c93-a3c2-60b048f60fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.636634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 771/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:35.637364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 776/1547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.638435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80308-e6ca-478b-99a9-a8932105a8ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.638665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fe57-7f71-4bd0-bece-e4ba203a2f32 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.638773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80308-e6ca-478b-99a9-a8932105a8ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.638955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fe57-7f71-4bd0-bece-e4ba203a2f32 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.639087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80308-e6ca-478b-99a9-a8932105a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.639201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fe57-7f71-4bd0-bece-e4ba203a2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.658596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6f71fe57-7f71-4bd0-bece-e4ba203a2f32 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.659820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6f71fe57-7f71-4bd0-bece-e4ba203a2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.666082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8be80308-e6ca-478b-99a9-a8932105a8ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.667270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8be80308-e6ca-478b-99a9-a8932105a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.719691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 777/1548] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.721390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fec49-5d43-4773-a5ef-76d4b8025a0e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.721840 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fec49-5d43-4773-a5ef-76d4b8025a0e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.722286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fec49-5d43-4773-a5ef-76d4b8025a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.725439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 772/1549] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.726767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09ea5-5489-4a2a-bd28-09dcc2afe89b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.727090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09ea5-5489-4a2a-bd28-09dcc2afe89b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.727390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09ea5-5489-4a2a-bd28-09dcc2afe89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.743127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b64fec49-5d43-4773-a5ef-76d4b8025a0e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.744378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b64fec49-5d43-4773-a5ef-76d4b8025a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.744940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c9a09ea5-5489-4a2a-bd28-09dcc2afe89b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.746364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c9a09ea5-5489-4a2a-bd28-09dcc2afe89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.752405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 778/1550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.753457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222431-f96f-484a-9d9b-7f1c72090c51 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.753717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222431-f96f-484a-9d9b-7f1c72090c51 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.753984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222431-f96f-484a-9d9b-7f1c72090c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.759769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 773/1551] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.759769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.759769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.759769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.776251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.776822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-66222431-f96f-484a-9d9b-7f1c72090c51 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.777463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.777996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-66222431-f96f-484a-9d9b-7f1c72090c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.785490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 774/1552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.793193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 779/1553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.793343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.793428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6a6f-565f-4a14-bf92-8877a221fd48 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.793428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6a6f-565f-4a14-bf92-8877a221fd48 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.793428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6a6f-565f-4a14-bf92-8877a221fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.799027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec3b26-71e1-4521-b093-24f567fe12cb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.803882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.804569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.804849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.805118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.805623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d67f6a6f-565f-4a14-bf92-8877a221fd48 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.805798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.806870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d67f6a6f-565f-4a14-bf92-8877a221fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.807777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.814777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 780/1554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.817728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.818022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.818914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.829099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 775/1555] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:35.830112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.838348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.839590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.839803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9162-404f-4408-a5f4-f045941d8fef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.844541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.845218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.845541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.845805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.846505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.846789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.847931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 781/1556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.848407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e6f4d-83fe-4787-bb7a-db8184957164 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.849552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.861478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ec21-bb59-472d-9148-eba1bc4b4f5d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.869221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 776/1557] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.869221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd6eac-8ef0-4ca5-bf30-b63bf710c5ae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.869221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd6eac-8ef0-4ca5-bf30-b63bf710c5ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.869221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd6eac-8ef0-4ca5-bf30-b63bf710c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.869581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.869581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.869581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.869581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.869879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.869879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.869879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:35.869879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:12:35.869879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:12:35.870540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.882334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 782/1558] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.882723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-28dd6eac-8ef0-4ca5-bf30-b63bf710c5ae None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.883331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.883950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-28dd6eac-8ef0-4ca5-bf30-b63bf710c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.892271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 777/1559] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.892693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023b79-a50e-49d1-8055-a9fe2430746e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.893535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.893826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.894111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.897551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.898201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.898482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.898758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.899480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.899785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.901452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.912314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:35.913516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:35.913807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 783/1560] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.914614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.926113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 778/1561] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:35.926914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.929229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ca0a-002f-4d18-8bba-84edb42838ad admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.933780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.934464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.934747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.935047 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.935758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.936069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.936231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49bacd-6fea-4223-8038-1ea1fdca8a54 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.937707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.940733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.941385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.941667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.941949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.942671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.944688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.950212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 784/1562] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.951136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.954760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 779/1563] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:35.958246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.962459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79071d-75c9-4aa1-8864-d9a8c9d6812d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.966977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.967630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.967860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789321f-fbcc-4a51-a013-8a3674c25b79 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:35.967989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.968182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.968940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:35.969246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.970847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.972373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:35.973054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:35.973448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:35.973728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:35.974401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:35.976274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:35.983439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 785/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:35.984554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:35.997438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0fe8-6d2e-49da-a9a4-21874fd4c4f0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.003319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.003840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 780/1565] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.003964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.004245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.004592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.004792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.006501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.007530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.042210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 786/1566] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:35 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.042210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.042552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.081841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.087842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3219a3-25ac-4b95-8f7d-f45953d8a4f4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.109364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981132-4e09-4c90-9797-a8a5dd5658d3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.113833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.114497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.114784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.115061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.115740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.117713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.149074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 787/1567] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.149074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.149359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.149359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.149359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.149359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.150033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:36.150627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.152292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.164585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 781/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:36.165558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.175130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a559a-e7a7-4d65-8e7a-c22ee274eb34 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.215602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eab7f-5769-431a-b8af-0072ee78a93d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.220721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.221382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.221680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.221955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.222686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:36.222980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.224670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.231055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.231730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.232022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.232301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.233029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.234958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.238599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 788/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:36.239342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.249012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a281-5abc-49ac-b2f0-7292bc68390e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.254517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.255185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.255467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.255770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.256524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.258120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.268347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 789/1570] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.269102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 782/1571] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.270000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.272403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.282579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40854d0-63dd-4fe1-9e67-5bbaef2d9cbf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.326013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.341017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e971099-983f-4a55-88dc-106b9975e5e3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.341415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.342092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.342377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.342652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.343353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.345311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.345596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.346256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.346556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.346826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.347521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.349462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.373976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 783/1572] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.375520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.379601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 790/1573] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.379601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.386229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6524c16-4605-4712-af87-d1275cd28da1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.408825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.445308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191852-cd55-4933-b061-c509d73cb290 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.446934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.447629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.447975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.448189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.448926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.450487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.450857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.451195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.451482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.451764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.452480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.453701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:36.453701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:12:36.453701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:12:36.454945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.474386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 784/1574] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.475293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.478354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 791/1575] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.479261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.486012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f83f9-6075-40ef-aacd-5a87c4102845 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.490545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e9eb-037f-4f46-ab4c-5ddf223d9214 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.490722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.491223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.491505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.491784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.492523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.494463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.496397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.497121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.497352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.497682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.498310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.500206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.522403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 785/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.525409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.530023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 792/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.530814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.589073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d5be-2a38-4f2b-9d3b-7f97b83fcfee admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.593117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2485c-11b9-462c-a607-d4695299a924 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.593897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.594805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.595074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.595356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] PATH_INFO: `/v3/projects/470d86bb3a034660aba1d1d1a768b718/users/bb218ceeb8eb4955850daa843fe03add/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.598172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.599614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.599898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.600175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.600908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.602845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.609834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470d86bb3a034660aba1d1d1a768b718, user_id=bb218ceeb8eb4955850daa843fe03add, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.610886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:36.610886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:12:36.610886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:12:36.612926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.624311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 793/1578] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.625302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.630950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 786/1579] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:36 2022] PUT /identity/v3/projects/470d86bb3a034660aba1d1d1a768b718/users/bb218ceeb8eb4955850daa843fe03add/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:36.630950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.635275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aae02-89a2-43e9-b018-87863e524995 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.662301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.697719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95160f74-b2eb-438f-b2cc-7aadeafcdec9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.698227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.698906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.699183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.699466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.700202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.701853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.702516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.703197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.703478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.703764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.704468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.706419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.711845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 794/1580] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.711845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.722617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151929-016e-4087-b129-1d7ed0dcc195 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.727176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.727791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 787/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.727949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.728142 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.728415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.728622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.729155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.730733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.739757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28967-3a77-426d-9c8a-b3570ba41081 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.743850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 795/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.743850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.748813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.749491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.749777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.750056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.750627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92b28-31df-4e4e-bd40-74ace292c350 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.750788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.752412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.755041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.755678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.755954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.756227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.756934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.758802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.763586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 788/1583] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.764395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.767891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.775181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69defa3-a8f4-4a8d-acd1-e274b1ace608 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.780015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.780723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.781013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.781294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.781983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.783343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 796/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.783928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cdee4-6bc4-4057-a4ea-7e742b4611f0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.784154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.795224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c35163-604f-4314-bfe8-300e71d71111 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.800573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.801042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.801321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.801594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.802315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.803909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.805453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 789/1585] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:36.806653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.806987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.807392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.822599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 797/1586] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.822599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.830383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:36.831633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:36.834135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc89cc0-b459-4bdb-a684-a2de8ff77650 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.838944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.839607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.839883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.840154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.840529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 790/1587] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:36.840905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.841314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.842495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.852313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760a46-9af4-4761-b7bc-7ecdb464c2c3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.857448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 798/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.857448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.862961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.863667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.864104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.864383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.865153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.866780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.867294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e10062-df2e-4436-953b-a2e31296463a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.872260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.872954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.873240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.873517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.874346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.875882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.881104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 791/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.881104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.890000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 799/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.890000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.893501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae9b-c654-4805-aaa5-0701148e72f1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.897322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664778c-67f2-4fe1-99f3-e85a5ae0012b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.898741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.899411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.899979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.900299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.901187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.901899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.902563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.902797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.902921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.903098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.903804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.905401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.913353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 792/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.914162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.916495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 800/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.916495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.925625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03ae1-6200-4638-ae36-db5fe4fd5bcd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.926785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcc54-e88b-4ee5-af8e-e4c20c1014b6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.930306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.931061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.931310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.931438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.931659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.931965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.932250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.932415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.932544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.933265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.934033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.934859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.944624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 801/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.945487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.945873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 793/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:36.946517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:36.951899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:36.959364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d7cd-b688-408c-aefd-d894caa1ccaf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:36.964003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:36.964904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:36.965186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:36.965457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] PATH_INFO: `/v3/projects/432d1f3b1a964e4fb7c8c59e2f163ac5/users/b40363c368a7480bbee286749ab5ca8e/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:36.980086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432d1f3b1a964e4fb7c8c59e2f163ac5, user_id=b40363c368a7480bbee286749ab5ca8e, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:36.982821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:36.998127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 794/1595] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:36 2022] PUT /identity/v3/projects/432d1f3b1a964e4fb7c8c59e2f163ac5/users/b40363c368a7480bbee286749ab5ca8e/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:36.999045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.007846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0bce-8fcf-454b-8a9a-7708b6c3c33c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.059621 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.060353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.060712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.061028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.070745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.071047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb9fc-df75-4fb5-ad3e-6743fb5ad3d1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.072429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.075638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.076348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.076670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.076983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.077686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.079322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.082409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 802/1596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:37.083229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.090012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 795/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:37.090700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.096155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963e87-a816-4431-b670-dd2e1115edba service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.100860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3520ae-0170-4e31-854a-770842c3fb3e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.102129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.103074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.103357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.103635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] PATH_INFO: `/v3/projects/b2ebe17e7f8841c4acc848b955f230c6/users/9ea320dbf059485c9468a0e033b39d90/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.106049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.107030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.107382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.107779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] PATH_INFO: `/v3/projects/0ba7d58e6bf0476794b71f224fc49b3d/users/2c07a7461fc74a6eb332d732bd98ece3/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.122505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ebe17e7f8841c4acc848b955f230c6, user_id=9ea320dbf059485c9468a0e033b39d90, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.125462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.131219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba7d58e6bf0476794b71f224fc49b3d, user_id=2c07a7461fc74a6eb332d732bd98ece3, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.139033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.146038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 803/1598] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/b2ebe17e7f8841c4acc848b955f230c6/users/9ea320dbf059485c9468a0e033b39d90/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.146038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.156724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:37.174910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 796/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/0ba7d58e6bf0476794b71f224fc49b3d/users/2c07a7461fc74a6eb332d732bd98ece3/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.174910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.186194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:37.222558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cfea3-853b-42be-b332-1c03b2473d31 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.249825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab49c2-e2d4-4a5a-949c-3e15562cbe4f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.255473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.257057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.257407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.257825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] PATH_INFO: `/v3/projects/c73c4a992746455a98d5aea61db0aab1/users/2fc1d78702b14141a69c151ccb3be945/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.282710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73c4a992746455a98d5aea61db0aab1, user_id=2fc1d78702b14141a69c151ccb3be945, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.285663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.300006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.300911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.301331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 797/1600] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/c73c4a992746455a98d5aea61db0aab1/users/2fc1d78702b14141a69c151ccb3be945/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.302095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.312232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.312442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.313324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.315118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f708-68b5-479e-b978-3c750c9a8cd7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.330632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 804/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:37.330632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03009f1-d6c2-4616-b1da-8a811ff38ee7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.330632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03009f1-d6c2-4616-b1da-8a811ff38ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.330632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03009f1-d6c2-4616-b1da-8a811ff38ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.362006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d03009f1-d6c2-4616-b1da-8a811ff38ee7 None None] MFA Rules not processed for user `b40363c368a7480bbee286749ab5ca8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.363232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d03009f1-d6c2-4616-b1da-8a811ff38ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.368899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb654b-274f-4be9-922d-3fbcfb6eb55a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.373571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.374251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.374817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.374817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.376142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.377807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.388142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 798/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:37.388983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.398442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09066dd-1204-486a-bab0-dba97435b59e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.403196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.404080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.404360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.404669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] PATH_INFO: `/v3/projects/f125705e83fb4982a34a20211c57ed58/users/d49798cb46a84cc8abad89604ec784f9/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.423446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f125705e83fb4982a34a20211c57ed58, user_id=d49798cb46a84cc8abad89604ec784f9, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.429812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36067c48-a12c-4444-aae8-4ab123ad9897 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.449133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 805/1603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:37.452126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8d6a-b7fe-4c18-a868-ecb4aa6fd294 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.452660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8d6a-b7fe-4c18-a868-ecb4aa6fd294 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.453192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8d6a-b7fe-4c18-a868-ecb4aa6fd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.454856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 799/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/f125705e83fb4982a34a20211c57ed58/users/d49798cb46a84cc8abad89604ec784f9/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.456689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.457278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.457611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.483432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8e6e8d6a-b7fe-4c18-a868-ecb4aa6fd294 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.485451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8e6e8d6a-b7fe-4c18-a868-ecb4aa6fd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.515141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] MFA Rules not processed for user `2c07a7461fc74a6eb332d732bd98ece3`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.517123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.561215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 806/1605] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:37.562613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcf63-fdc9-460d-b642-5543ac809afe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.562904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcf63-fdc9-460d-b642-5543ac809afe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.563184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcf63-fdc9-460d-b642-5543ac809afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.568051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:37.574155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:37.596683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 800/1606] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:37.597800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.604631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6adfcf63-fdc9-460d-b642-5543ac809afe None None] MFA Rules not processed for user `2fc1d78702b14141a69c151ccb3be945`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.605786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6adfcf63-fdc9-460d-b642-5543ac809afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.608734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651089-bcf5-4856-be31-66ceb55c5e6a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.613690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.614695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.615041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.615385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] PATH_INFO: `/v3/projects/32c2857e5c574a10bde11546249b3145/users/b38f935893cf43afb8ac9a247e76079e/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.631336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c2857e5c574a10bde11546249b3145, user_id=b38f935893cf43afb8ac9a247e76079e, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.635261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.653797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 801/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/32c2857e5c574a10bde11546249b3145/users/b38f935893cf43afb8ac9a247e76079e/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.654976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.685100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 807/1608] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:37.685100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.685100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.685100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.713196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.714466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.727387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec263-766c-479c-a7e1-8aff5e0dc751 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.732307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.737445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.737728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.738005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] PATH_INFO: `/v3/projects/23782d526cdb46ce9c837b07041bc9fb/users/22ef2fb5ef6c4afb8933aa5563807895/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.755862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23782d526cdb46ce9c837b07041bc9fb, user_id=22ef2fb5ef6c4afb8933aa5563807895, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.758957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1aa84-a476-4d01-835f-5beda2c8e95b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.775292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 802/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:37 2022] PUT /identity/v3/projects/23782d526cdb46ce9c837b07041bc9fb/users/22ef2fb5ef6c4afb8933aa5563807895/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:37.776776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0c6c-76c4-489a-a64a-4a0c104e6d17 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.777084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0c6c-76c4-489a-a64a-4a0c104e6d17 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.777356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0c6c-76c4-489a-a64a-4a0c104e6d17 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.779055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 803/1610] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 5 16:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:37.779775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f0c6c-76c4-489a-a64a-4a0c104e6d17 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.798015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 808/1611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:37.799745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.813539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaf838-321f-4201-a870-b9903505fa87 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.854870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f0c6c-76c4-489a-a64a-4a0c104e6d17 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.859139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.860229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.860678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.861052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.889379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:37.890358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.890819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.891143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.891892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.894763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf948d-e18c-4d89-8e94-a8e39e9fbe77 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.927266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:37.933433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 809/1612] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:37.934489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f06a8-1ea0-4cdc-979c-addaaaacacd8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:37.934827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f06a8-1ea0-4cdc-979c-addaaaacacd8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:37.935108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f06a8-1ea0-4cdc-979c-addaaaacacd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:37.941331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:37.944102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:37.957731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 804/1613] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:37.958194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-dc3f06a8-1ea0-4cdc-979c-addaaaacacd8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:37.959057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:37.959760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc3f06a8-1ea0-4cdc-979c-addaaaacacd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:37.970889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293b5b-4abb-4dcf-8873-35987e707d52 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:37.976723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:38.047036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 810/1614] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:38.048568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.048971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.049340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.051061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.051752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.052094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.052308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.053246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.055114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8f96-224e-4f2f-b65b-3fcff70626c6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.073246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:38.074863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:38.088759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 805/1615] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:37 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:38.090221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.090606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.091009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.129243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] MFA Rules not processed for user `22ef2fb5ef6c4afb8933aa5563807895`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:38.130367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:38.175951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 811/1616] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 5 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:38.176730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.246406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 806/1617] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:38.248187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.250194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac60e-7bd2-4bdf-be3b-904596507ca7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.309153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.313732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.315720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.316259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.349743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:38.411774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.413964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.433395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 812/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:38.434827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.446169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37660c-d363-4f73-a7ea-c280e19264c1 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.451685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.454171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.454586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.454805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.465972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.468310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.495413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 813/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:38.501008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.515968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c88f7-d0a3-4be5-b009-c3b1254bf595 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.520441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458464a-4d16-4e1d-92e0-cb34115437b6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.522339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.523246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.523678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.524113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.525090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.525788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.526545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.527063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.527897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.528913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.529608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.532188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.546449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:38.567607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 807/1620] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:38 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:38.569205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 814/1621] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:38 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:38.570443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.573026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.665108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a02-ea83-450e-8415-442a12547bc6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.672553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.673700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.674252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.674964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.676021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd70ee-ef43-4661-bab8-b7793b30183c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.683135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.684060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.685846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.686332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.688442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.689970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.715530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 815/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:38.725399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.747518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6836c-1d88-4a79-9950-f34361440d61 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.762918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.765672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.765964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.766247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.766992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.772515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.800594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 816/1623] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:38.801583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.820146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.821980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a8cc8-f16d-41ec-acb7-c8406b4ce110 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.824266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.835667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.836838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.837127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.837633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.838823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.840912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.851867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 808/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:38.853414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.870433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 817/1625] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:38.873728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.880254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdeab6-1841-4793-8a5d-dbe2b3fd5172 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.893281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.894297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.894581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.894854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] PATH_INFO: `/v3/projects/1a53f646f2564c8190e3e5f296139a7b/users/8923bdf7b3b3448bbe176d1d4026c422/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.895490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478a716-f219-496a-839b-e6ab7ba27589 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:38.906896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:38.907884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:38.908172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:38.908501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] PATH_INFO: `/v3/projects/28e4bc448c72498d81b17417d8bb024d/users/b276550a4ff242589f0caa66e2bd292a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:38.931878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a53f646f2564c8190e3e5f296139a7b, user_id=8923bdf7b3b3448bbe176d1d4026c422, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.937988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.945953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e4bc448c72498d81b17417d8bb024d, user_id=b276550a4ff242589f0caa66e2bd292a, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:38.950823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:38.970949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 809/1626] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:38 2022] PUT /identity/v3/projects/1a53f646f2564c8190e3e5f296139a7b/users/8923bdf7b3b3448bbe176d1d4026c422/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:38.972243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:38.988564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 818/1627] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:38 2022] PUT /identity/v3/projects/28e4bc448c72498d81b17417d8bb024d/users/b276550a4ff242589f0caa66e2bd292a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:38.992481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:39.152729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:39.179628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969e14-237d-4355-b0ea-e9bd7ab39179 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:39.203273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fee74a-2bc5-4585-aea3-bb35369114b6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:39.208322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:39.214310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:39.214310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.214310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.214310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.214752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:39.215435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:39.247527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 819/1628] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:39.248590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:39.264144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b81c-1e17-49a8-8e8f-1ace242a8e06 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:39.273053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:39.274804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.275437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.276949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] PATH_INFO: `/v3/projects/28e4bc448c72498d81b17417d8bb024d/users/b276550a4ff242589f0caa66e2bd292a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.283330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e4bc448c72498d81b17417d8bb024d, user_id=b276550a4ff242589f0caa66e2bd292a, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:39.291579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018a5aa-5df0-4823-8b5c-a389e3aaafcf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:39.332826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 820/1629] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:39 2022] PUT /identity/v3/projects/28e4bc448c72498d81b17417d8bb024d/users/b276550a4ff242589f0caa66e2bd292a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:39.394649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.394649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.394649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.395164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:39.395164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.395164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.395164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.401114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:39.413417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:39.437328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] MFA Rules not processed for user `b276550a4ff242589f0caa66e2bd292a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:39.437328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:39.450570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 810/1630] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:39.463864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:39.492822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f1b7-a85f-4782-b4c6-aae6c188d4ca admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:39.556499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 821/1631] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:39.570309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:39.687271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627edee-7754-4e85-9823-cff6caf48aec None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:39.696276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:39.698453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.698753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.699040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] PATH_INFO: `/v3/projects/1a53f646f2564c8190e3e5f296139a7b/users/8923bdf7b3b3448bbe176d1d4026c422/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.699888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:39.701052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.701577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.701760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a53f646f2564c8190e3e5f296139a7b, user_id=8923bdf7b3b3448bbe176d1d4026c422, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:39.702364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.704793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e0762-be2b-4c35-93ff-eb21acabcf7e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:39.725425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:39.728029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:39.729516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 811/1632] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:39 2022] PUT /identity/v3/projects/1a53f646f2564c8190e3e5f296139a7b/users/8923bdf7b3b3448bbe176d1d4026c422/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:12:39.746924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19a81-7012-4b33-b989-4fd52c255f62 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:39.747224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19a81-7012-4b33-b989-4fd52c255f62 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:39.747760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19a81-7012-4b33-b989-4fd52c255f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:39.755183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 822/1633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:39.842051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f7d19a81-7012-4b33-b989-4fd52c255f62 None None] MFA Rules not processed for user `8923bdf7b3b3448bbe176d1d4026c422`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:39.848165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f7d19a81-7012-4b33-b989-4fd52c255f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:40.131397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 812/1634] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:40.143293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:40.153180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc9b6-11b0-431b-9613-22203ff75d76 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:40.192592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6e28-208e-48ce-99a9-4279223e26b5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.192959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6e28-208e-48ce-99a9-4279223e26b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.193840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6e28-208e-48ce-99a9-4279223e26b5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.196540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 813/1635] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 5 16:12:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:40.204928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa889d43-9b8e-4079-b7ec-6d2f8da23efe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.205216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa889d43-9b8e-4079-b7ec-6d2f8da23efe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.205499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa889d43-9b8e-4079-b7ec-6d2f8da23efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.243234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa889d43-9b8e-4079-b7ec-6d2f8da23efe None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:40.245580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa889d43-9b8e-4079-b7ec-6d2f8da23efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:40.322645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:40.328628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:40.329400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.330879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.332958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.367483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:40.373626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35119-5449-4286-a9ee-497a27f17d94 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:40.389006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:40.405594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 823/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:40.442293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 814/1637] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 5 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:40.449240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe0f9-825b-4723-9629-792096bb8ec1 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.449448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe0f9-825b-4723-9629-792096bb8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.449703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe0f9-825b-4723-9629-792096bb8ec1 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.451218 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 824/1638] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 5 16:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:40.466156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.467900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.468982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.518704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:40.520841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:40.560751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 815/1639] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:40.564302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe0f9-825b-4723-9629-792096bb8ec1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:40.586628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe0f9-825b-4723-9629-792096bb8ec1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:40.591589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:40.592150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.592911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.593193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.614536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:40.626483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eaf8d-457b-4842-96ed-2b2c2b0c393c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:40.633496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:40.634487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.634764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.635096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.650027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:40.651925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad39b2c-448e-4a4c-b484-10a1b6cef192 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:40.677374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:40.678970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5046b21-8c7d-47c9-939a-0bde50059092 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:40.693660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 825/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:40.695848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 816/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:40.970230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15e6e-9ba7-4704-b3ed-97565a88b171 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.970448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15e6e-9ba7-4704-b3ed-97565a88b171 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.970809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d15e6e-9ba7-4704-b3ed-97565a88b171 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:40.973338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 826/1642] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 5 16:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:40.984569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:40.985197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:40.985197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.018544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:41.019787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:41.047803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 817/1643] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:41.121831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d15e6e-9ba7-4704-b3ed-97565a88b171 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:41.141105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d15e6e-9ba7-4704-b3ed-97565a88b171 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:41.144798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:41.145501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:41.145754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:41.146031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.158153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:41.183638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:41.185138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:41.243007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 827/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:41.331064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095f7eb-8186-444b-8746-6bad6c7bea6c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:41.340279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:41.341225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:41.341511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:41.341791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] PATH_INFO: `/v3/users/2fc1d78702b14141a69c151ccb3be945` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.343277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc1d78702b14141a69c151ccb3be945)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:41.344518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: WARNING py.warnings [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:41.344518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: warnings.warn(msg) Jul 05 16:12:41.344518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: Jul 05 16:12:41.345739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:41.375455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:41.389647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1d9f3-14dd-4659-acf5-3465c28e2ae2 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:41.407075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:41.408881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:41.409386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:41.410565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] PATH_INFO: `/v3/users/b40363c368a7480bbee286749ab5ca8e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.413328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40363c368a7480bbee286749ab5ca8e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:41.416707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:41.478629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc1d78702b14141a69c151ccb3be945'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.479271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc1d78702b14141a69c151ccb3be945'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.483819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc1d78702b14141a69c151ccb3be945'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.529427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc1d78702b14141a69c151ccb3be945'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.529666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40363c368a7480bbee286749ab5ca8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.530707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40363c368a7480bbee286749ab5ca8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.531434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40363c368a7480bbee286749ab5ca8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.546597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40363c368a7480bbee286749ab5ca8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.554411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-cb9170a4-1a48-4006-9f7b-4bf07da6a4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc1d78702b14141a69c151ccb3be945'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.559427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4096c00a-32ae-4505-9208-765ff667efe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40363c368a7480bbee286749ab5ca8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:41.614664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 828/1645] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:41 2022] DELETE /identity/v3/users/b40363c368a7480bbee286749ab5ca8e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:41.619396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:41.619684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:41.620033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.631992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 818/1646] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:41 2022] DELETE /identity/v3/users/2fc1d78702b14141a69c151ccb3be945 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:41.636491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:41.637022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:41.637461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:41.675052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:41.677753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:41.677998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:41.687611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:41.704752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:41.848874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 819/1647] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:41.855512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:41.892579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 829/1648] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:41.899270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:41.901572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:41.958407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:41.960016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:42.027447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17959a-6274-490d-8199-163ba54d24a6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:42.033929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:42.034758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:42.035050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:42.035338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:42.066870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:42.071825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:42.079996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7678f-3ddf-4134-b875-b8eb31ca8c09 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:42.092010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:42.092991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:42.093482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:42.093750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:42.098142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 820/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:42.114100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:42.115717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50f0d-d687-49aa-aec6-fe0135fd8817 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:42.129723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 830/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:43.502567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:43.504865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:43.527544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275a0b-7036-43e5-9787-cee33de47018 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:43.541938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:43.543008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:43.543388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:43.543766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] PATH_INFO: `/v3/projects/432d1f3b1a964e4fb7c8c59e2f163ac5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:43.549911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432d1f3b1a964e4fb7c8c59e2f163ac5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:43.552249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:43.723033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432d1f3b1a964e4fb7c8c59e2f163ac5', 'request_id': 'req-acf0acdd-2746-48eb-abb0-c33470448357'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:43.736235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432d1f3b1a964e4fb7c8c59e2f163ac5', 'request_id': 'req-acf0acdd-2746-48eb-abb0-c33470448357'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:43.755154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432d1f3b1a964e4fb7c8c59e2f163ac5', 'request_id': 'req-acf0acdd-2746-48eb-abb0-c33470448357'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:43.773563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] The token cache is being invalidate because project 432d1f3b1a964e4fb7c8c59e2f163ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:43.773911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:43.775597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-acf0acdd-2746-48eb-abb0-c33470448357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:43.777879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 821/1651] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:43 2022] DELETE /identity/v3/projects/432d1f3b1a964e4fb7c8c59e2f163ac5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:43.788805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:43.789509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:43.793240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:43.893848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:43.895147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:44.100279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 831/1652] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:44.109432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.109728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.110095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.205732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:44.211675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:44.250973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 822/1653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:44.265075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.279256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3693fc-09f6-4b66-9d04-0ec9120d85c8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.299369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.300073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.300353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.300654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.301387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:44.301695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.303358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.350053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 832/1654] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:44.354139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.378981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0fc5a-82d2-4324-8c60-2fa0c4921160 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.401381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.402068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.402352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.402633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.403360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.411899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.502604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 823/1655] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:44 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:44.506881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.526677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c703dc-0ec0-4655-9ce4-7eb52af2f6ff admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.697104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.697928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.698567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.698861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.699670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.701764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.742834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 833/1656] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:44 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:44.744234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.764315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e8daa-8eb6-4fe5-b32a-37b0234281b7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.783546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.788621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.790089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.792978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.793968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.795979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.842290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.843310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 824/1657] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:44.858617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5003d-8738-4f68-99de-78fecd4d7095 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.880049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.881049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.882008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.882434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.883291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.887228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.900760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.902570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:44.917653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:44.920584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 834/1658] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:12:44.924198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:44.934109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c98-7879-4962-9350-4b43f72b467d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.941383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:44.948235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.949169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.949447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.949719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] PATH_INFO: `/v3/projects/c73c4a992746455a98d5aea61db0aab1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:44.950645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35f6c8-d721-4234-8e3c-d3f75743cd19 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:44.953779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73c4a992746455a98d5aea61db0aab1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:44.957913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:44.963943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:44.968020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:44.969138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:44.970240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] PATH_INFO: `/v3/projects/2d9dfd30fa274dfb9cb010c0396e8207/users/a17d1ebff1b148abb483f975d2facf8b/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:45.015977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9dfd30fa274dfb9cb010c0396e8207, user_id=a17d1ebff1b148abb483f975d2facf8b, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:45.025014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe73135-f3fc-40b3-be80-6c6503a6d79b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:45.083197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 835/1659] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:44 2022] PUT /identity/v3/projects/2d9dfd30fa274dfb9cb010c0396e8207/users/a17d1ebff1b148abb483f975d2facf8b/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:12:45.093619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:45.093900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:45.094479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:45.123138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73c4a992746455a98d5aea61db0aab1', 'request_id': 'req-c55a9ea1-125a-4cf7-a677-b06d877c9889'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.142412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73c4a992746455a98d5aea61db0aab1', 'request_id': 'req-c55a9ea1-125a-4cf7-a677-b06d877c9889'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.159353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] MFA Rules not processed for user `a17d1ebff1b148abb483f975d2facf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:45.160854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:45.164908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73c4a992746455a98d5aea61db0aab1', 'request_id': 'req-c55a9ea1-125a-4cf7-a677-b06d877c9889'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.195133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] The token cache is being invalidate because project c73c4a992746455a98d5aea61db0aab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:45.198311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.200808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.212428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 825/1660] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:44 2022] DELETE /identity/v3/projects/c73c4a992746455a98d5aea61db0aab1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:12:45.217507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:45.225483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:45.420864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 836/1661] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:45.422052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:45.428285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:45.448683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a9ea1-125a-4cf7-a677-b06d877c9889 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:45.454027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:45.455055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:45.455440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:45.455819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] PATH_INFO: `/v3/users/b276550a4ff242589f0caa66e2bd292a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:45.457205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b276550a4ff242589f0caa66e2bd292a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:45.469201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:45.481720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b85a-5a74-4f05-8e2f-91d992d2b2a5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:45.494888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:45.495831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:45.496365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:45.496879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:45.497727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:45.501228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:45.652496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b276550a4ff242589f0caa66e2bd292a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.653033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 837/1662] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:45 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:45.653866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b276550a4ff242589f0caa66e2bd292a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.654988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b276550a4ff242589f0caa66e2bd292a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.658204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:45.662572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:45.673860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b276550a4ff242589f0caa66e2bd292a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.697661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b276550a4ff242589f0caa66e2bd292a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:45.791987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 826/1663] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:45 2022] DELETE /identity/v3/users/b276550a4ff242589f0caa66e2bd292a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:45.898417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146371-ac61-41ed-9012-153cd5e51713 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:46.096958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:46.120597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:46.121367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.124383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.124737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.125495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:46.138073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:46.214658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 838/1664] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:45 2022] POST /identity/v3/users => generated 297 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:46.216237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:46.224542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:46.234585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188832f-a9f1-4cf3-96c7-be5057359856 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:46.249847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f868-e089-474b-b447-32087772f714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:46.250951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f868-e089-474b-b447-32087772f714 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.253230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f868-e089-474b-b447-32087772f714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.256952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f868-e089-474b-b447-32087772f714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.258271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735f868-e089-474b-b447-32087772f714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:46.262364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735f868-e089-474b-b447-32087772f714 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:46.304328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:46.304850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 827/1665] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:46.323164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1733-5b47-42e1-8bb2-8561980b2f59 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:46.345992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:46.346932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.347440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.347672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] PATH_INFO: `/v3/projects/0c416735a2f14a1fa5800193632fabd9/users/04b99596e9db4626a87b7ec70a00d921/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.406523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c416735a2f14a1fa5800193632fabd9, user_id=04b99596e9db4626a87b7ec70a00d921, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:46.416069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:46.442638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 839/1666] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:46 2022] PUT /identity/v3/projects/0c416735a2f14a1fa5800193632fabd9/users/04b99596e9db4626a87b7ec70a00d921/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:46.446946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f868-e089-474b-b447-32087772f714 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:46.461951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f868-e089-474b-b447-32087772f714 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:46.594447 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:46.595527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.596056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.596543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.597750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:46.599619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad34b-6365-42ca-94d8-8381c115826f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:46.626754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 828/1667] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:46.626878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:46.640659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688087b-0003-4022-8ab2-df8bdf54bf21 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:46.657243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:46.658419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.660270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.662714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] PATH_INFO: `/v3/projects/0c416735a2f14a1fa5800193632fabd9/users/04b99596e9db4626a87b7ec70a00d921/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.667118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c416735a2f14a1fa5800193632fabd9, user_id=04b99596e9db4626a87b7ec70a00d921, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:46.675331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:46.714089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 840/1668] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:46 2022] PUT /identity/v3/projects/0c416735a2f14a1fa5800193632fabd9/users/04b99596e9db4626a87b7ec70a00d921/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:46.715299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:46.715753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:46.716177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:46.813040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] MFA Rules not processed for user `04b99596e9db4626a87b7ec70a00d921`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:46.821020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.101018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 829/1669] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:47.165329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:47.167736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.212747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:47.212747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.342311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b492a-1036-4a27-b21e-489e2b4ebef7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:47.350693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6c63-0656-4b87-b3fd-a58e6c78636c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:47.355569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:47.356293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:47.356602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:47.356969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] PATH_INFO: `/v3/projects/28e4bc448c72498d81b17417d8bb024d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:47.369992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e4bc448c72498d81b17417d8bb024d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:47.371872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:47.374624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:47.375483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:47.375929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:47.376343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:47.399123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:47.402457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc9b41-c89b-4e2c-bd13-bc4922c2a14c service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:47.418675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:47.431112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 841/1670] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:47.473684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e4bc448c72498d81b17417d8bb024d', 'request_id': 'req-50a60d84-4159-4213-abc5-2da359d17d2b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:47.485764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e4bc448c72498d81b17417d8bb024d', 'request_id': 'req-50a60d84-4159-4213-abc5-2da359d17d2b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:47.511417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e4bc448c72498d81b17417d8bb024d', 'request_id': 'req-50a60d84-4159-4213-abc5-2da359d17d2b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:47.549262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] The token cache is being invalidate because project 28e4bc448c72498d81b17417d8bb024d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:47.550564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:47.551524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:47.554811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 830/1671] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:47 2022] DELETE /identity/v3/projects/28e4bc448c72498d81b17417d8bb024d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:47.559595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c05-cf79-4516-bfb9-834aa28a20c3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:47.559888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c05-cf79-4516-bfb9-834aa28a20c3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:47.560214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c05-cf79-4516-bfb9-834aa28a20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:47.586506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:47.590027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.614950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c7432c05-cf79-4516-bfb9-834aa28a20c3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:47.616243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c7432c05-cf79-4516-bfb9-834aa28a20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.819953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60d84-4159-4213-abc5-2da359d17d2b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:47.833558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:47.834285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:47.835436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:47.835721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:47.843799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.852785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 842/1672] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:47.858443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:47.858733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:47.859014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:47.917873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:47.919334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:47.973474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 843/1673] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:47.977455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.001724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.003406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.004479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bcd27-3f39-413f-a351-32ed28779c18 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.016199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.018164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.018620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.019065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.019969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:48.020488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.024352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 831/1674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:48.025742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.060650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 844/1675] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:12:48.066475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.082365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6553-014b-4720-a0a3-c0a2abc07568 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.089146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.091134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.091561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.091975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.093666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.097818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.149257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 832/1676] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:48 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:48.153273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.178058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12d84-1ab6-439e-9c6a-d3cc6d9229c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.258832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:48.331468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.334909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.334909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.335064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.336967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.345465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.392569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 845/1677] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:48 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:48.394307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.410015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddea25-a6f1-45cb-a4d5-d5a397401b6d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.424978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.425785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.426081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.429970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.430982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.435396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.467724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 833/1678] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:48.474254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.498461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a8107-b8cb-47f3-b422-e8a9ff954c27 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.515505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.523156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.524021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.524432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.527762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.529574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d4ad0-ed8e-4c80-9797-d3f77703156a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.555631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 846/1679] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:48.557099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.577218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061636-2425-4b79-9e78-badda5f68cd7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.586784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.588025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.588428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.588817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] PATH_INFO: `/v3/projects/b50f8ff0a1914987950af0ac6463d772/users/78126308e92e414a85d07ef8594baedc/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.612747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50f8ff0a1914987950af0ac6463d772, user_id=78126308e92e414a85d07ef8594baedc, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.619128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:48.643266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 834/1680] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:48 2022] PUT /identity/v3/projects/b50f8ff0a1914987950af0ac6463d772/users/78126308e92e414a85d07ef8594baedc/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:12:48.655239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.655629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.655994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.716523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] MFA Rules not processed for user `78126308e92e414a85d07ef8594baedc`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:48.719993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:48.866084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 847/1681] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:48.871217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:48.879976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:48.961520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c4cd0-b34b-4fa8-b410-6873355aaf4e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:48.966960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:48.967888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:48.968377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:48.968984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:48.969901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:48.972105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.007703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 835/1682] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:49.011217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:49.026858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ec0b2-e4e1-4d7c-bb2d-2be2142c3e56 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:49.105597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:49.105816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.106402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.106709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.107563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:49.109743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.146397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:49.155958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 848/1683] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:49 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:49.161548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635d6e-d566-485f-b49d-1aa9e7c754cf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:49.167075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:49.167774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.168058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.169122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.169950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:49.171909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.191158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 836/1684] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:49.192733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:49.209017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3718a-e0b9-4fee-951d-7480836d544c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:49.216364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:49.217610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.218086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.218958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] PATH_INFO: `/v3/projects/b93ac03c22cd4db5b712a5ef02363b48/users/0ea2d5c09f3243e19f5d44e91608f56b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.238441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93ac03c22cd4db5b712a5ef02363b48, user_id=0ea2d5c09f3243e19f5d44e91608f56b, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:49.241919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.278133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 849/1685] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:49 2022] PUT /identity/v3/projects/b93ac03c22cd4db5b712a5ef02363b48/users/0ea2d5c09f3243e19f5d44e91608f56b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:49.279031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:49.300865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f979c7-e712-4407-93af-f192ffa00b50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:49.459243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:49.459943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.460232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.460547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.461291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:49.462965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2e06-646d-4b1b-baac-bcd987a274ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.490981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 837/1686] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:49.500747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:49.513985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:49.528281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c867-90af-4245-9ab6-2935a2828ebe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:49.547098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:49.549234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.549673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.553156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] PATH_INFO: `/v3/projects/b93ac03c22cd4db5b712a5ef02363b48/users/0ea2d5c09f3243e19f5d44e91608f56b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.568717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93ac03c22cd4db5b712a5ef02363b48, user_id=0ea2d5c09f3243e19f5d44e91608f56b, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:49.573654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:49.601603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 850/1687] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:49 2022] PUT /identity/v3/projects/b93ac03c22cd4db5b712a5ef02363b48/users/0ea2d5c09f3243e19f5d44e91608f56b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:49.613549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:49.613820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:49.614111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:49.693849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] MFA Rules not processed for user `0ea2d5c09f3243e19f5d44e91608f56b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:49.696880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:49.878635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:49.906488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 838/1688] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:49.982155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:50.080186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e686-fb83-4338-ac63-2d46306aff9a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:50.084397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:50.089410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:50.089728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:50.090036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:50.119359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:50.120693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb97300-21e2-4f8e-9cbc-6d76921b6a85 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:50.142332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 851/1689] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:50.187348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:50.316336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105dba-df6f-482e-94b3-18ce1aee9ab8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:50.328642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:50.330025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:50.330308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:50.330584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] PATH_INFO: `/v3/users/78126308e92e414a85d07ef8594baedc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:50.332840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78126308e92e414a85d07ef8594baedc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:50.337086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:50.448182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78126308e92e414a85d07ef8594baedc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:50.449505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78126308e92e414a85d07ef8594baedc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:50.451555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78126308e92e414a85d07ef8594baedc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:50.461587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78126308e92e414a85d07ef8594baedc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:50.478228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78126308e92e414a85d07ef8594baedc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:50.552911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 839/1690] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:50 2022] DELETE /identity/v3/users/78126308e92e414a85d07ef8594baedc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:50.557232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee74-593f-4423-af09-c545bea4367f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:50.557232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee74-593f-4423-af09-c545bea4367f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:50.558724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee74-593f-4423-af09-c545bea4367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:50.598877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6709ee74-593f-4423-af09-c545bea4367f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:50.600129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6709ee74-593f-4423-af09-c545bea4367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:50.774904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 852/1691] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:50.809219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:50.810446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:50.927317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a6f7-86da-4dde-ad6a-1e10e597a50f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:50.927881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:50.927881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:50.927881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:50.937664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:50.938258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:50.939709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:50.939709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:50.962698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:50.968843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:50.969593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] MFA Rules not processed for user `d49798cb46a84cc8abad89604ec784f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:50.970906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:50.998899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 840/1692] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:51.102658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 853/1693] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:51.110873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:51.112756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:51.153267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:51.289105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f889964-1392-4dec-9bfc-c03c2dc414a9 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:51.296951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:51.297928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:51.298427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:51.298920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:51.331450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:51.331450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d2625-1295-40ff-b7fe-98dfcd49a6ae service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:51.354107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 841/1694] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:51.830679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:51.832188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:51.857990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be150f2-f492-4c2e-b84b-612d809c09fe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:51.872759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:51.874289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:51.874760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:51.875171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] PATH_INFO: `/v3/users/22ef2fb5ef6c4afb8933aa5563807895` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:51.876924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ef2fb5ef6c4afb8933aa5563807895)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:51.879304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:51.929779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:52.001087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ef2fb5ef6c4afb8933aa5563807895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:52.001825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ef2fb5ef6c4afb8933aa5563807895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:52.002648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ef2fb5ef6c4afb8933aa5563807895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:52.035221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ef2fb5ef6c4afb8933aa5563807895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:52.052857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d0a2f0d-0273-486b-8c32-66f306754ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ef2fb5ef6c4afb8933aa5563807895'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:52.110790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 854/1695] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:51 2022] DELETE /identity/v3/users/22ef2fb5ef6c4afb8933aa5563807895 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:52.112366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:52.113148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:52.113594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:52.152219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:52.161244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:52.293668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:52.293961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:52.294244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:52.350200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 842/1696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:52.354485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] MFA Rules not processed for user `bb218ceeb8eb4955850daa843fe03add`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:52.355759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:52.385586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:52.387977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:52.540394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 855/1697] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:52.543568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad44f4-c910-48ef-bf89-aceeba976585 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:52.556591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:52.558035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:52.563835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:52.564913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:52.565569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:52.566016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:52.586949 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:52.588581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:52.606194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 843/1698] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:52.713271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6c37c-ddfd-4f0c-8a3c-4aad3f50c40b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:52.719565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:52.720403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:52.720841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:52.721252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:52.740951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:52.742448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:52.761671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 856/1699] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:12:53.815227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:53.817148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:53.853875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbb4ec-9323-465f-8eb8-4b69343f210c service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:53.881478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:53.890464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:53.890944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:53.891110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] PATH_INFO: `/v3/projects/b50f8ff0a1914987950af0ac6463d772` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:53.896989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50f8ff0a1914987950af0ac6463d772)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:53.907329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:54.070487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:54.084551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50f8ff0a1914987950af0ac6463d772', 'request_id': 'req-4d011f0a-e831-4361-9bf7-d9a168a4651e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.121796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50f8ff0a1914987950af0ac6463d772', 'request_id': 'req-4d011f0a-e831-4361-9bf7-d9a168a4651e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.140539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50f8ff0a1914987950af0ac6463d772', 'request_id': 'req-4d011f0a-e831-4361-9bf7-d9a168a4651e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.174490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] The token cache is being invalidate because project b50f8ff0a1914987950af0ac6463d772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:54.174821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.177636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.182052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 844/1700] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:53 2022] DELETE /identity/v3/projects/b50f8ff0a1914987950af0ac6463d772 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:54.185343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:54.209642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e310-a26d-466d-863f-2e73a367664f service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:54.227173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:54.229234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:54.251998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:54.411847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011f0a-e831-4361-9bf7-d9a168a4651e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:54.426197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:54.427901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:54.436965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:54.438024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] PATH_INFO: `/v3/projects/23782d526cdb46ce9c837b07041bc9fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:54.441707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23782d526cdb46ce9c837b07041bc9fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:54.447137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:54.454802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:54.455730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:54.456016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:54.456281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] PATH_INFO: `/v3/users/0ea2d5c09f3243e19f5d44e91608f56b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:54.459726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea2d5c09f3243e19f5d44e91608f56b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:54.504985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:54.603906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23782d526cdb46ce9c837b07041bc9fb', 'request_id': 'req-2393c209-4ccb-4f3b-8907-e31ad8fa569e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.611745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23782d526cdb46ce9c837b07041bc9fb', 'request_id': 'req-2393c209-4ccb-4f3b-8907-e31ad8fa569e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.625879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23782d526cdb46ce9c837b07041bc9fb', 'request_id': 'req-2393c209-4ccb-4f3b-8907-e31ad8fa569e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.631497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea2d5c09f3243e19f5d44e91608f56b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.640694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea2d5c09f3243e19f5d44e91608f56b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.641452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea2d5c09f3243e19f5d44e91608f56b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.664050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea2d5c09f3243e19f5d44e91608f56b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.665731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] The token cache is being invalidate because project 23782d526cdb46ce9c837b07041bc9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:54.666246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.667904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2393c209-4ccb-4f3b-8907-e31ad8fa569e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.670050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 845/1701] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:54 2022] DELETE /identity/v3/projects/23782d526cdb46ce9c837b07041bc9fb => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:54.676940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:54.677629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:54.678052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:54.682634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d23f96f-1b7f-4f9d-bdea-2bfbcff17966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea2d5c09f3243e19f5d44e91608f56b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:54.739919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:54.741485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:54.746080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 857/1702] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:54 2022] DELETE /identity/v3/users/0ea2d5c09f3243e19f5d44e91608f56b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:54.845651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 846/1703] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:54.853031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7702-19f8-4009-9680-90349150711e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:54.853327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7702-19f8-4009-9680-90349150711e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:54.853700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7702-19f8-4009-9680-90349150711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:54.920294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-524c7702-19f8-4009-9680-90349150711e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:54.930957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-524c7702-19f8-4009-9680-90349150711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:54.967898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 858/1704] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:54.972314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:54.979929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:54.993315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b3eb-d541-4f1f-aef9-e39a423d83a1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.020238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.023829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.028088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.028547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.031568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:55.032077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.037794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.089517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 847/1705] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:55.094059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c7702-19f8-4009-9680-90349150711e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:55.112994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c7702-19f8-4009-9680-90349150711e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.141577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.142429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.142842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.143271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.144097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.149660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.256579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:55.256803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 859/1706] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:55 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:55.294156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc3b22-38fc-4a32-88c2-deb5aab802b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.501317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.501317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.501662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.501901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.502597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.509444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.572589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 848/1707] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:55 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:12:55.576593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:55.592323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259ce75-d7ae-469d-8773-b1a4bca77e6a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.622090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.622842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.623484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.623665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.624646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.626706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.675358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 860/1708] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:55.679785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:55.699620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4444-32ae-4f57-82a3-abbbd46d811d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.721530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.721951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.722242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.722522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.723265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.727192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bbbac-d238-4194-b1b8-c5c76e3ff8a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.775009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 849/1709] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:55.776276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:55.795336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4c61-eb24-4270-99fc-c005e30117c0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:55.810939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:55.812225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.814848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.815275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] PATH_INFO: `/v3/projects/3513bcc34dfa4183b73e5626c79e7e57/users/c6bfcd633b5a43cf99ac22944121885f/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.858682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3513bcc34dfa4183b73e5626c79e7e57, user_id=c6bfcd633b5a43cf99ac22944121885f, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:55.861445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903ac1-2e2e-4415-8ebc-f14ebfeb62c3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:55.898706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 861/1710] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:55 2022] PUT /identity/v3/projects/3513bcc34dfa4183b73e5626c79e7e57/users/c6bfcd633b5a43cf99ac22944121885f/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:12:55.910348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6643a-2acd-4390-a8ca-164a61ac1e5f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.910861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6643a-2acd-4390-a8ca-164a61ac1e5f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.911509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6643a-2acd-4390-a8ca-164a61ac1e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:55.981687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-80d6643a-2acd-4390-a8ca-164a61ac1e5f None None] MFA Rules not processed for user `c6bfcd633b5a43cf99ac22944121885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:55.995961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-80d6643a-2acd-4390-a8ca-164a61ac1e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:55.999131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:55.999423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:55.999705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.032064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] MFA Rules not processed for user `d49798cb46a84cc8abad89604ec784f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:56.033356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:56.104144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:56.214702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 862/1711] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:56.235653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 850/1712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:56.239934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:56.315652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d32a-184a-4dbb-87d2-513eeac2a9f4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.319775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d32a-184a-4dbb-87d2-513eeac2a9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.320289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d32a-184a-4dbb-87d2-513eeac2a9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.396016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a8d2d32a-184a-4dbb-87d2-513eeac2a9f4 None None] MFA Rules not processed for user `9ea320dbf059485c9468a0e033b39d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:56.398549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a8d2d32a-184a-4dbb-87d2-513eeac2a9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:56.463098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c65e1-976b-42a2-9346-ded73065c8f4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:56.497726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:56.499559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.500957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.501730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.506520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:56.509167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:56.582919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:56.587134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 863/1713] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:56 2022] POST /identity/v3/projects => generated 371 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:56.590901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:56.635972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 851/1714] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:56.643668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.644062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.644431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.683748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] MFA Rules not processed for user `9ea320dbf059485c9468a0e033b39d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:56.687733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:56.742249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57f9c-9eed-446c-8c8b-19a93aa45b07 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:56.756094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:56.756931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.757827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.758188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.761164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:56.763508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:56.810669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 864/1715] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:56 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:56.812687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:56.816683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:56.829041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 852/1716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:12:56.830211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:56.844122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd8-9af0-46ea-9a0d-29d235e2e5e2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:56.853624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ade0d-ed58-44c8-8bd1-2e6b940529e2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:56.858026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:56.859025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.860339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.860654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] PATH_INFO: `/v3/projects/b93ac03c22cd4db5b712a5ef02363b48` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.863378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93ac03c22cd4db5b712a5ef02363b48)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:56.864430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: WARNING py.warnings [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:12:56.864430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: warnings.warn(msg) Jul 05 16:12:56.864430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: Jul 05 16:12:56.865646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:56.869358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:56.870212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:56.870497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:56.870797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:56.871650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:56.873339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:56.908687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 853/1717] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:56.908687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:56.914274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.005012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:57.044148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93ac03c22cd4db5b712a5ef02363b48', 'request_id': 'req-ff9d16ba-777a-4e05-aafa-48f1ea232c99'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.096942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93ac03c22cd4db5b712a5ef02363b48', 'request_id': 'req-ff9d16ba-777a-4e05-aafa-48f1ea232c99'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.135859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93ac03c22cd4db5b712a5ef02363b48', 'request_id': 'req-ff9d16ba-777a-4e05-aafa-48f1ea232c99'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.155864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] The token cache is being invalidate because project b93ac03c22cd4db5b712a5ef02363b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:12:57.156281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.156988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.161954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 865/1718] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:12:56 2022] DELETE /identity/v3/projects/b93ac03c22cd4db5b712a5ef02363b48 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:57.162793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:57.166286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.186737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d069-34e8-4b38-af67-47111496bc84 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:57.338015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d16ba-777a-4e05-aafa-48f1ea232c99 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:57.355122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:57.356058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.356341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.358007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] PATH_INFO: `/v3/projects/282b04f941324855ac90b87d34bab7df/users/c85fd75c6f2040b185ac3a5bae9a2011/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.422388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282b04f941324855ac90b87d34bab7df, user_id=c85fd75c6f2040b185ac3a5bae9a2011, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:57.425126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a18b-9248-4804-a7f6-63abfc007ac7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:57.430853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:57.444529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.444944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.445326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.459746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.492745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 866/1719] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:57 2022] PUT /identity/v3/projects/282b04f941324855ac90b87d34bab7df/users/c85fd75c6f2040b185ac3a5bae9a2011/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:57.495590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dacfa-6d93-47e0-acb5-f84cb457320c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.495987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dacfa-6d93-47e0-acb5-f84cb457320c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.496274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dacfa-6d93-47e0-acb5-f84cb457320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.507065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:57.536794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-165dacfa-6d93-47e0-acb5-f84cb457320c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:57.538132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-165dacfa-6d93-47e0-acb5-f84cb457320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.616891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:57.621029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:57.642366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 854/1720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:57.659877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:57.670380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.700104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 867/1721] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:57.700104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fd8b-a62b-483b-aa29-7c7df317ebec None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.700104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fd8b-a62b-483b-aa29-7c7df317ebec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.700104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fd8b-a62b-483b-aa29-7c7df317ebec None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.702211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 868/1722] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 5 16:12:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:57.703510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f4db-578e-4538-976c-91381f253227 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.703796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f4db-578e-4538-976c-91381f253227 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.704073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f4db-578e-4538-976c-91381f253227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.708531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08622fa-bf29-4ea0-8d4d-52af64599c94 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:57.719351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:57.720260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.720573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.720851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] PATH_INFO: `/v3/users/a17d1ebff1b148abb483f975d2facf8b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:57.722075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17d1ebff1b148abb483f975d2facf8b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:57.724275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:57.760101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8392f4db-578e-4538-976c-91381f253227 None None] MFA Rules not processed for user `b38f935893cf43afb8ac9a247e76079e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:57.761581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8392f4db-578e-4538-976c-91381f253227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.812296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17d1ebff1b148abb483f975d2facf8b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.813564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17d1ebff1b148abb483f975d2facf8b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.815432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17d1ebff1b148abb483f975d2facf8b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.833276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17d1ebff1b148abb483f975d2facf8b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.860540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17d1ebff1b148abb483f975d2facf8b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:12:57.897498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:57.907948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 855/1723] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:12:57 2022] DELETE /identity/v3/users/a17d1ebff1b148abb483f975d2facf8b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:57.907948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:57.910316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:57.965154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 869/1724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:57.967036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fa5a-5489-43f8-9572-bcc47b2380cf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:57.967213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fa5a-5489-43f8-9572-bcc47b2380cf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:57.967495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fa5a-5489-43f8-9572-bcc47b2380cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.017493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5ce8fa5a-5489-43f8-9572-bcc47b2380cf None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.018739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5ce8fa5a-5489-43f8-9572-bcc47b2380cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.071092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a86-5ad5-4add-8a43-7d6a12b4f219 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:58.077941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:58.078651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.078937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.079493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.080679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:58.082684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75c3b-9dd7-462a-8432-eabcc9578d7b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:58.096350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 856/1725] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:58.098594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7f01-d4cd-4ac3-b9c2-3db3290700bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.098893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7f01-d4cd-4ac3-b9c2-3db3290700bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.099449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7f01-d4cd-4ac3-b9c2-3db3290700bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.149233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-74de7f01-d4cd-4ac3-b9c2-3db3290700bd None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.150692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-74de7f01-d4cd-4ac3-b9c2-3db3290700bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.157391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:58.257704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 857/1726] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:58.259453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6905b68-a21a-43a2-9b34-93889c9d760a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.259932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6905b68-a21a-43a2-9b34-93889c9d760a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.260229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6905b68-a21a-43a2-9b34-93889c9d760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.286896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d6905b68-a21a-43a2-9b34-93889c9d760a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.289120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d6905b68-a21a-43a2-9b34-93889c9d760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.308736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 858/1727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:58.323029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.323553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.323665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.354279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] MFA Rules not processed for user `b38f935893cf43afb8ac9a247e76079e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.357927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 870/1728] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:58.358047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.358145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a1e6-5520-4fdc-b755-f947f825a2e4 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.358145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a1e6-5520-4fdc-b755-f947f825a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.358145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a1e6-5520-4fdc-b755-f947f825a2e4 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.360232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 871/1729] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 5 16:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:12:58.361223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545a1e6-5520-4fdc-b755-f947f825a2e4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:58.398734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545a1e6-5520-4fdc-b755-f947f825a2e4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:58.407724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:58.408959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.409433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.409847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] PATH_INFO: `/v3/projects/282b04f941324855ac90b87d34bab7df/users/c85fd75c6f2040b185ac3a5bae9a2011/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.412430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=282b04f941324855ac90b87d34bab7df, user_id=c85fd75c6f2040b185ac3a5bae9a2011, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:58.417057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:58.450018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 872/1730] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:58 2022] PUT /identity/v3/projects/282b04f941324855ac90b87d34bab7df/users/c85fd75c6f2040b185ac3a5bae9a2011/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:58.461649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:58.465629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.471194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 859/1731] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:58.472319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:58.488602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.528433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a057-45ec-418f-ac28-a2e3df3be788 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:58.621503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:58.622223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.622507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.622783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.641202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630d3b-3da1-489d-9595-b8fa6a53dc9d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:58.645882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:58.649138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.649423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.649701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.660011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:58.661615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:58.675110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 873/1732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:58.676105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:58.792402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:58.795273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616410ae-26b1-457e-9aa7-688200b2de32 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:58.825464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 860/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:58.826985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec505-5dc8-48bb-bd02-e9d12bc207b7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.827375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec505-5dc8-48bb-bd02-e9d12bc207b7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.827751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec505-5dc8-48bb-bd02-e9d12bc207b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.854310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa923d-35b6-4f48-94b5-51b84ccfab4c service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:58.860021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:58.860744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.861026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.865531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.866650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:12:58.866974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:58.868994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bfdf-fbfb-4a9e-bcdd-f34c5ccecc5d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:58.890428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9a3ec505-5dc8-48bb-bd02-e9d12bc207b7 None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.897180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9a3ec505-5dc8-48bb-bd02-e9d12bc207b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.905382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 874/1734] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:12:58.907278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.907575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.907853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.916666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 861/1735] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:58.918106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:58.918394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:58.918703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:58.933648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:58.947017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:58.959039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] MFA Rules not processed for user `bb218ceeb8eb4955850daa843fe03add`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.961109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:58.979195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] MFA Rules not processed for user `c85fd75c6f2040b185ac3a5bae9a2011`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:58.980609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:59.113792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 862/1736] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:59.115442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.135897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ec7c3-f170-42fe-a2d1-daf30f140a88 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.139229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 875/1737] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:12:59.144316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.163487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.166535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861735cc-74ce-4e17-8605-040522abeeeb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.168787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.169109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.169366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.170100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.170295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.171105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.171387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.171669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.172047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.179872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.181418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.211007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 876/1738] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:59.213447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.214271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:59.235530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 863/1739] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:12:59 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:59.236689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.357332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1eaf7-5bc0-4396-9937-e360d3d6686e service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.394484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387faab9-4ba1-4ee9-b8ff-6a7a7ae8f42d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.409525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.410827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.411292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.413621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.414673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.419160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.476251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 864/1740] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:12:59 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:12:59.480359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.489057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.490397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.491936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.492353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.504084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768532b-9c44-4597-aef4-2186576aeb1e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.515151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.516852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.517277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.517789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.520854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.525298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.577975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 865/1741] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:12:59.581688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.614604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c5c6-6a2a-4a5d-8a7e-5cd87b540e3e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.630401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.631406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.632652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.633021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.634023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.636124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.652475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:59.665868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 866/1742] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:12:59.672384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.676820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:12:59.678865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.682495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.707797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 877/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:12:59.714707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:12:59.745552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46cd26-f839-4a7a-a3b5-ecd45ae33a43 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.754711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:12:59.756893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.757380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.757926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] PATH_INFO: `/v3/projects/8699157dbbd145aab38befd84bb868ce/users/09ede18a9d554aec9c63b85b17ae1393/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.795680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8699157dbbd145aab38befd84bb868ce, user_id=09ede18a9d554aec9c63b85b17ae1393, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:12:59.813128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765db582-f296-4c5d-aeda-9b6a624c838e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:12:59.827267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:59.843248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 878/1744] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:12:59 2022] PUT /identity/v3/projects/8699157dbbd145aab38befd84bb868ce/users/09ede18a9d554aec9c63b85b17ae1393/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:12:59.860553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc562-7da3-4807-91ae-7f320c4d51ae None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:12:59.861072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc562-7da3-4807-91ae-7f320c4d51ae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:12:59.861565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc562-7da3-4807-91ae-7f320c4d51ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:12:59.888359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e02ea-82d0-4f09-bb11-375b30ac7dfd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:12:59.929574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cf9fc562-7da3-4807-91ae-7f320c4d51ae None None] MFA Rules not processed for user `09ede18a9d554aec9c63b85b17ae1393`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:12:59.933461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cf9fc562-7da3-4807-91ae-7f320c4d51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.112391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:00.113217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.113573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.113916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.196972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 879/1745] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:12:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:00.196972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc9b8-bb44-4a53-be9f-3878920eabef None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.196972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc9b8-bb44-4a53-be9f-3878920eabef None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.196972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdc9b8-bb44-4a53-be9f-3878920eabef None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.196972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 880/1746] 10.222.0.43 () {54 vars in 960 bytes} [Tue Jul 5 16:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:13:00.198710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdc9b8-bb44-4a53-be9f-3878920eabef None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.232369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:00.234635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:00.251099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 867/1747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:12:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:00.257641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.259215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.338701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdc9b8-bb44-4a53-be9f-3878920eabef None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:00.352367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:00.353090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.353370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.353647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.356656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.357404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890d3c-64d6-49ee-bc89-470ea5565570 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:00.362336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:00.363235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.363501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.363779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] PATH_INFO: `/v3/projects/2d9dfd30fa274dfb9cb010c0396e8207` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.365003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9dfd30fa274dfb9cb010c0396e8207)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:00.366926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:00.428075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:00.454458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9dfd30fa274dfb9cb010c0396e8207', 'request_id': 'req-c82bbf96-f261-4f8f-87e5-43a38963adf9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:00.466767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9dfd30fa274dfb9cb010c0396e8207', 'request_id': 'req-c82bbf96-f261-4f8f-87e5-43a38963adf9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:00.486708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9dfd30fa274dfb9cb010c0396e8207', 'request_id': 'req-c82bbf96-f261-4f8f-87e5-43a38963adf9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:00.507536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:00.509097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf72dae-c761-4e7b-812e-87c0e132b31a service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:00.513064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] The token cache is being invalidate because project 2d9dfd30fa274dfb9cb010c0396e8207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:00.515901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:00.517588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:00.522909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 868/1748] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:00 2022] DELETE /identity/v3/projects/2d9dfd30fa274dfb9cb010c0396e8207 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:00.522909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.524244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.542114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 881/1749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:00.548177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.548486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.548827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.576399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:00.613040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:00.620160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.743166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbf96-f261-4f8f-87e5-43a38963adf9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:00.753843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:00.760558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.761268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.761806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.766859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:00.770711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:00.777580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 882/1750] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Jul 5 16:13:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:00.778506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.779803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.819774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54283281-8363-4fe6-a473-1f88c7ef5f61 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:00.836634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:00.837522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:00.837797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:00.838062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:00.843270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.862734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:00.866317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:00.880509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 869/1751] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:00 2022] POST /identity/v3/projects => generated 381 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:00.884369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.885079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 883/1752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:00.886148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:00.888900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:00.901909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929bf15-09c6-4452-b730-dd6172f164c3 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.057308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.058425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.058709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.058983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.084175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.097437 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.109803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 884/1753] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:01.110686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.117845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf10e2-5073-4dc0-a145-63300a672be0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.128480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.129513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.131006 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5003bc-bbb3-4782-a62a-08e79c985a1f service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.132636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.132964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] PATH_INFO: `/v3/users/04b99596e9db4626a87b7ec70a00d921` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.134872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b99596e9db4626a87b7ec70a00d921)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.138487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.146366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.147357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.147640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.147920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.148709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.151352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.191114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 885/1754] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:01 2022] POST /identity/v3/users => generated 297 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:01.192477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.206948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8275b-82bd-4f89-941a-8c88e78b62b4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.214373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.215541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.216022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.216436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.217735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.220181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.240650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 886/1755] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:01.242381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.243405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:01.247484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b99596e9db4626a87b7ec70a00d921'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.250528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b99596e9db4626a87b7ec70a00d921'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.252253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b99596e9db4626a87b7ec70a00d921'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.258209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96537d-ce47-45e6-95f4-6999a0934f46 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.265640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.267158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.267580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.267989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] PATH_INFO: `/v3/projects/7b7142edf9db4cecb689fa2961109b1f/users/780b291bfe5243e88f50b737cb151ac1/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.268759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b99596e9db4626a87b7ec70a00d921'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.297228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b99596e9db4626a87b7ec70a00d921'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.315205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7142edf9db4cecb689fa2961109b1f, user_id=780b291bfe5243e88f50b737cb151ac1, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.318551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.336609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 887/1756] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:01 2022] PUT /identity/v3/projects/7b7142edf9db4cecb689fa2961109b1f/users/780b291bfe5243e88f50b737cb151ac1/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:01.340853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.343595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:01.379259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 870/1757] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:00 2022] DELETE /identity/v3/users/04b99596e9db4626a87b7ec70a00d921 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:01.389888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:01.483838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8919063-44d2-47da-b6a8-6d95a983f97d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.514006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.515455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:01.660854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a50eef-23d8-4c43-9768-9662171646f6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.665949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.666663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.667071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.667326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.668072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.669744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.673355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.677510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.679860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.682195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] PATH_INFO: `/v3/users/2c07a7461fc74a6eb332d732bd98ece3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.685696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c07a7461fc74a6eb332d732bd98ece3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.691624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.716950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 888/1758] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:01.717882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:01.732926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7848-3f22-4526-8874-5d70e3eb5e46 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:01.746254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:01.747295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.747583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.747867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] PATH_INFO: `/v3/projects/7b7142edf9db4cecb689fa2961109b1f/users/780b291bfe5243e88f50b737cb151ac1/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.750617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7142edf9db4cecb689fa2961109b1f, user_id=780b291bfe5243e88f50b737cb151ac1, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:01.768856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39047581-011d-4de5-bdb8-947cc1e56bf3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:01.814998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c07a7461fc74a6eb332d732bd98ece3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.815703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c07a7461fc74a6eb332d732bd98ece3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.816499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c07a7461fc74a6eb332d732bd98ece3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.816625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 889/1759] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:01 2022] PUT /identity/v3/projects/7b7142edf9db4cecb689fa2961109b1f/users/780b291bfe5243e88f50b737cb151ac1/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:01.836389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.836747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.836979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.841626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c07a7461fc74a6eb332d732bd98ece3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.865236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5cd4454-f9f7-40ff-a0c4-8cf71dd073d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c07a7461fc74a6eb332d732bd98ece3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:01.936301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 871/1760] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:01 2022] DELETE /identity/v3/users/2c07a7461fc74a6eb332d732bd98ece3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:01.942342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:01.942639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:01.944714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:01.945577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] MFA Rules not processed for user `780b291bfe5243e88f50b737cb151ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:01.948294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:02.051628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:02.056399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:02.134694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 890/1761] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:02.142628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:02.149727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:02.196562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:02.216366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:02.265412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 872/1762] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:02.273033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4af3-452d-4f5a-8cae-97e02e87cf2d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:02.289872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:02.291352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:02.292579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:02.293104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:02.306738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:02.308783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:02.336903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 891/1763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:02.359110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:02.360665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:02.376638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:02.378100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:02.423498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8348-995c-481c-b8b9-c3505332895f service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:02.462837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:02.473529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:02.473529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:02.473529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] PATH_INFO: `/v3/projects/0c416735a2f14a1fa5800193632fabd9` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:02.485815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c416735a2f14a1fa5800193632fabd9)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:02.497168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:02.679188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54b74f-ef5d-4c23-978d-05fb6104ea3b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:02.768711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c416735a2f14a1fa5800193632fabd9', 'request_id': 'req-23b01722-b17d-4ec7-a861-4ceec958345f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:02.809890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c416735a2f14a1fa5800193632fabd9', 'request_id': 'req-23b01722-b17d-4ec7-a861-4ceec958345f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:02.859456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c416735a2f14a1fa5800193632fabd9', 'request_id': 'req-23b01722-b17d-4ec7-a861-4ceec958345f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:02.926191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] The token cache is being invalidate because project 0c416735a2f14a1fa5800193632fabd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:02.926495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:02.928017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-23b01722-b17d-4ec7-a861-4ceec958345f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:02.940152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 892/1764] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:02 2022] DELETE /identity/v3/projects/0c416735a2f14a1fa5800193632fabd9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:02.952872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b011-8b1b-4c62-a0a5-da38a6e05202 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:02.953163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b011-8b1b-4c62-a0a5-da38a6e05202 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:02.957446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b011-8b1b-4c62-a0a5-da38a6e05202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:02.992493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:02.993179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:02.993466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:02.993750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:03.005263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:03.037176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2154b011-8b1b-4c62-a0a5-da38a6e05202 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:03.046900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2154b011-8b1b-4c62-a0a5-da38a6e05202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:03.329184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:03.339169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:03.352986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 893/1765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:03.385154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:03.385620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:03.386042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:03.443105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 873/1766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1085 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:03.460002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:03.491614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:03.545645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 894/1767] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:03.546881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:03.559926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb69f2-374d-4e5c-a139-b06518644761 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:03.595928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:03.598908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:03.601279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:03.602148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:03.602429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:03.602705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:03.603715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:03.603959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:03.605940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:03.661338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 874/1768] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:03.663208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:03.713557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9864-8d66-44ac-9868-267ba589ac15 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:03.736442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:03.737258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:03.737467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:03.737714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:03.738417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:03.740577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:03.832179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 875/1769] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:03 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:03.833894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:03.865031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:03.883065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f323-f9f9-4bfa-a760-d4778a08a7f9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:03.900539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:03.982390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309618-9a35-428c-89a8-a055d7ccf2b5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:03.998298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:03.999281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:03.999706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.000155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.004484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.011699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc63f5-2aa5-451b-b846-e66e3952fb20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.040886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '780b291bfe5243e88f50b737cb151ac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b7142edf9db4cecb689fa2961109b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.041561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.042354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.042687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.045061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:04.045394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.050033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.074684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 876/1770] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:03 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:04.077229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.079668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.080139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.088351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 895/1771] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:04.091316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.124289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e7c6-2cd5-4665-82ba-c10d588a25b5 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.133836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] MFA Rules not processed for user `9ea320dbf059485c9468a0e033b39d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:04.135092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:04.138317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.140416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.140416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.140416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.141333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.144140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.174281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 896/1772] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:04.174879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.208589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be46d-4b02-473e-ba0c-56c6bade1100 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.217816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '780b291bfe5243e88f50b737cb151ac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b7142edf9db4cecb689fa2961109b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.218662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.218912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.219202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.219910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.224401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.327981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 897/1773] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:04 2022] POST /identity/v3/projects => generated 353 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:04.332130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.339759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 877/1774] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:04.341363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.366837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43d3b9-5502-47d5-8e4b-094d31f2f154 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.454093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc3f9-a061-415d-a077-37e9a5d2eb75 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.458761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.459448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.459726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.460170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.461519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.463590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.493104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 898/1775] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:04.505607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.507229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '780b291bfe5243e88f50b737cb151ac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b7142edf9db4cecb689fa2961109b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.509985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.511422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.511719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.513673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:04.513996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.518259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.541275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd649e-247a-4d5a-8349-980f96f65753 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.555872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 878/1776] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:04.564094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.566708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.571412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.572109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] PATH_INFO: `/v3/projects/6b1ed9a3576e43878d4c33e84937dffe/users/7dac305c9eff44ec86e4ba218bbb11ae/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.612188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.615050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:04.616376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1ed9a3576e43878d4c33e84937dffe, user_id=7dac305c9eff44ec86e4ba218bbb11ae, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.621146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.657624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 899/1777] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:04 2022] PUT /identity/v3/projects/6b1ed9a3576e43878d4c33e84937dffe/users/7dac305c9eff44ec86e4ba218bbb11ae/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:04.660602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:04.661289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1944a84-01ea-4ea4-90f8-bc1e54210151 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.770487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:04.783389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:04.857909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.859065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.859183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.859384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] PATH_INFO: `/v3/projects/0ba7d58e6bf0476794b71f224fc49b3d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.863997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8899-71bb-4e2d-a6e2-a45a4eee4dca admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:04.869615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba7d58e6bf0476794b71f224fc49b3d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.893340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:04.899163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '780b291bfe5243e88f50b737cb151ac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b7142edf9db4cecb689fa2961109b1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:04.900928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:04.901431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:04.902090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] PATH_INFO: `/v3/projects/de4e05dcfb0e4cab95668b7a5273ac3d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:04.907409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de4e05dcfb0e4cab95668b7a5273ac3d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:04.916960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:05.066463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4e05dcfb0e4cab95668b7a5273ac3d', 'request_id': 'req-f9979c40-fec7-4b96-a8ce-615b4c9c3082'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.075661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4e05dcfb0e4cab95668b7a5273ac3d', 'request_id': 'req-f9979c40-fec7-4b96-a8ce-615b4c9c3082'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.084819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4e05dcfb0e4cab95668b7a5273ac3d', 'request_id': 'req-f9979c40-fec7-4b96-a8ce-615b4c9c3082'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.120877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] The token cache is being invalidate because project de4e05dcfb0e4cab95668b7a5273ac3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:05.122961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba7d58e6bf0476794b71f224fc49b3d', 'request_id': 'req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.124695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.125921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9979c40-fec7-4b96-a8ce-615b4c9c3082 tempest-VolumeQuotaClassesTest-2046277546 tempest-VolumeQuotaClassesTest-2046277546-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.133866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 900/1778] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:04 2022] DELETE /identity/v3/projects/de4e05dcfb0e4cab95668b7a5273ac3d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:05.154033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:05.154322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:05.165271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba7d58e6bf0476794b71f224fc49b3d', 'request_id': 'req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.166353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:05.202238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba7d58e6bf0476794b71f224fc49b3d', 'request_id': 'req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.221916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] The token cache is being invalidate because project 0ba7d58e6bf0476794b71f224fc49b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:05.222403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.223367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.228816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 879/1779] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:04 2022] DELETE /identity/v3/projects/0ba7d58e6bf0476794b71f224fc49b3d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:05.233512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:05.235234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:05.291017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] MFA Rules not processed for user `7dac305c9eff44ec86e4ba218bbb11ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:05.301266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:05.435618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63818e-c8c7-42f1-a546-e8ba28e43c1b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:05.562162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 901/1780] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:05.567951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:05.571672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:05.659780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:05.660925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:05.661041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:05.661255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] PATH_INFO: `/v3/users/8923bdf7b3b3448bbe176d1d4026c422` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:05.665584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8923bdf7b3b3448bbe176d1d4026c422)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:05.671807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:05.747521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:05.776719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6c1d5-93d4-405f-8a87-5b6ae9d85629 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:05.782679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:05.783376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:05.783656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:05.783925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:05.784696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:05.786868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:05.791017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:05.803086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8923bdf7b3b3448bbe176d1d4026c422'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.813400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8923bdf7b3b3448bbe176d1d4026c422'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.814300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8923bdf7b3b3448bbe176d1d4026c422'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.841096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8923bdf7b3b3448bbe176d1d4026c422'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.851110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 902/1781] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:05 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:05.852228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:05.857134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8923bdf7b3b3448bbe176d1d4026c422'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:05.859348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:05.922133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 880/1782] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:05 2022] DELETE /identity/v3/users/8923bdf7b3b3448bbe176d1d4026c422 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:05.923467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:05.925215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:06.036288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e622cd-e405-4c41-bd4d-1369f94a129c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:06.094850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431208c-94cb-46d2-83db-05e6709b1fa8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:06.117350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:06.118054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.118345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.118625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.119335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:06.121710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e91dc-d62b-4926-931e-e3abb638a570 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:06.156856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 881/1783] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:05 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:06.158294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.158579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.158860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.176704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:06.177754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.178049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:06.178504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.178792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] PATH_INFO: `/v3/users/09ede18a9d554aec9c63b85b17ae1393` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.179335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:06.181137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ede18a9d554aec9c63b85b17ae1393)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:06.183772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:06.326507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 882/1784] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:06.328469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:06.357533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ede18a9d554aec9c63b85b17ae1393'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:06.368414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ede18a9d554aec9c63b85b17ae1393'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:06.369821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ede18a9d554aec9c63b85b17ae1393'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:06.386956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc4945-b5b8-4525-848d-7e2b978d4a9e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:06.400194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ede18a9d554aec9c63b85b17ae1393'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:06.405165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:06.407341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.407634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.410848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.415926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:06.421720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:06.428619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9e708d88-fffd-420c-aff5-ce06ca67f1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ede18a9d554aec9c63b85b17ae1393'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:06.471397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 883/1785] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:06.474276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:06.478398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:06.496702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 903/1786] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:05 2022] DELETE /identity/v3/users/09ede18a9d554aec9c63b85b17ae1393 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:06.508439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.510643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef837fa-de86-4063-9e8b-c6edbff68857 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:06.511158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.512114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.586857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:06.611611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:06.617044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:06.646563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:06.711928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:06.714381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:06.715445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:06.715872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] PATH_INFO: `/v3/projects/e91ce586a70b422795acbf7f46b0fc79/users/212b8da5bd1a4de0b5f6a697e023e030/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:06.775408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91ce586a70b422795acbf7f46b0fc79, user_id=212b8da5bd1a4de0b5f6a697e023e030, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:06.819207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:06.867140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 884/1787] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:06 2022] PUT /identity/v3/projects/e91ce586a70b422795acbf7f46b0fc79/users/212b8da5bd1a4de0b5f6a697e023e030/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:06.868228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:06.870089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:06.883312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 904/1788] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:06.891602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:06.931619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5572d-a82d-4714-8f15-42b84f4d2799 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:07.133480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053455b-1a46-4166-bf3c-512027e6f41e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:07.149825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:07.151241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.151729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.151923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:07.152428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.152668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.152958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.153241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.154239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:07.158330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:07.163066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:07.180847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 905/1789] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:07.186904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:07.212953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa710fc-b0b4-4884-bcaa-5656e6a3eb98 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:07.228619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:07.229673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.230060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.230441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] PATH_INFO: `/v3/projects/e91ce586a70b422795acbf7f46b0fc79/users/212b8da5bd1a4de0b5f6a697e023e030/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.234745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91ce586a70b422795acbf7f46b0fc79, user_id=212b8da5bd1a4de0b5f6a697e023e030, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:07.244955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bad112-ea2e-49ca-80ec-81ee37961596 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:07.277730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 906/1790] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:07 2022] PUT /identity/v3/projects/e91ce586a70b422795acbf7f46b0fc79/users/212b8da5bd1a4de0b5f6a697e023e030/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:07.291600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.292222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.292948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.326632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:07.328401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:07.352030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 885/1791] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:13:07.354174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] MFA Rules not processed for user `212b8da5bd1a4de0b5f6a697e023e030`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:07.356208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:07.372097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:07.375243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:07.560634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:07.578030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef950f-2f67-4d7e-862e-7489fd4012f2 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:07.627240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 907/1792] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:07.638788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:07.641410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:07.735685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:07.806144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:07.808067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.811792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.812883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.899853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766d36-539f-4fc2-8482-49db1f4002a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:07.916147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:07.917299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:07.917789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:07.918284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:07.932762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:07.935520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:07.962796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 908/1793] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:08.110535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:08.112890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433173a1-afd6-425a-9bd8-6d1f6c275a6f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:08.155488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 886/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:08.901996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:08.916076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cecd99-e476-44f4-bf05-9a02a539a90a service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:08.928680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:08.929894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:08.930327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:08.930841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] PATH_INFO: `/v3/users/7dac305c9eff44ec86e4ba218bbb11ae` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:08.934183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dac305c9eff44ec86e4ba218bbb11ae)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:08.940349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:09.045403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dac305c9eff44ec86e4ba218bbb11ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:09.048878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dac305c9eff44ec86e4ba218bbb11ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:09.049665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dac305c9eff44ec86e4ba218bbb11ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:09.066207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dac305c9eff44ec86e4ba218bbb11ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:09.088373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dac305c9eff44ec86e4ba218bbb11ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:09.125995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:09.127080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:09.127580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:09.129647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 909/1795] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:08 2022] DELETE /identity/v3/users/7dac305c9eff44ec86e4ba218bbb11ae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:09.163635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:09.165873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:09.430500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 887/1796] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:09.493697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:09.495593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:09.698547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419855d1-bb81-42a3-81fd-678ece73e88e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:09.712907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:09.713784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:09.714251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:09.714656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:09.740048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:09.742511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:09.769972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 910/1797] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:10.952385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:10.954651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:10.975494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1a6b-f02e-4083-95f1-4e68b7d89637 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:10.991477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:10.992436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:10.992749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:10.993037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] PATH_INFO: `/v3/projects/1a53f646f2564c8190e3e5f296139a7b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:10.994498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:10.995995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:11.007045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a53f646f2564c8190e3e5f296139a7b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:11.011870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:11.021576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc58d-e1e3-4d89-b192-60e85dbcad0f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:11.049033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:11.049940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.051732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.052044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] PATH_INFO: `/v3/projects/8699157dbbd145aab38befd84bb868ce` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.053784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8699157dbbd145aab38befd84bb868ce)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:11.055804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:11.233585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:11.235188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:11.252164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a53f646f2564c8190e3e5f296139a7b', 'request_id': 'req-66ea4392-5767-4bf7-9ea9-6863b63f1221'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.263317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a53f646f2564c8190e3e5f296139a7b', 'request_id': 'req-66ea4392-5767-4bf7-9ea9-6863b63f1221'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.281223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8699157dbbd145aab38befd84bb868ce', 'request_id': 'req-c4c77aa2-f881-4dfd-8572-9f14d9728054'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.291795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a53f646f2564c8190e3e5f296139a7b', 'request_id': 'req-66ea4392-5767-4bf7-9ea9-6863b63f1221'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.292713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8699157dbbd145aab38befd84bb868ce', 'request_id': 'req-c4c77aa2-f881-4dfd-8572-9f14d9728054'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.324518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8699157dbbd145aab38befd84bb868ce', 'request_id': 'req-c4c77aa2-f881-4dfd-8572-9f14d9728054'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.331783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] The token cache is being invalidate because project 1a53f646f2564c8190e3e5f296139a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:11.334003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.337116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-66ea4392-5767-4bf7-9ea9-6863b63f1221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.344897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 888/1798] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:10 2022] DELETE /identity/v3/projects/1a53f646f2564c8190e3e5f296139a7b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:11.345948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4667-324f-481b-a617-a77c302ad99f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.347331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4667-324f-481b-a617-a77c302ad99f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.347720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4667-324f-481b-a617-a77c302ad99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.366080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] The token cache is being invalidate because project 8699157dbbd145aab38befd84bb868ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:11.366294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.367035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.369057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 911/1799] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:10 2022] DELETE /identity/v3/projects/8699157dbbd145aab38befd84bb868ce => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:11.372746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:11.378088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:11.414622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b05e4667-324f-481b-a617-a77c302ad99f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:11.419309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b05e4667-324f-481b-a617-a77c302ad99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:11.580847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77aa2-f881-4dfd-8572-9f14d9728054 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:11.600300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 889/1800] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:11.603404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.603964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.604516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.612549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:11.613671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.615697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.618339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] PATH_INFO: `/v3/users/780b291bfe5243e88f50b737cb151ac1` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.620166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=780b291bfe5243e88f50b737cb151ac1)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:11.628157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:11.631037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:11.633438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:11.667868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 890/1801] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:11.669059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:11.689515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a354b-76ab-4440-9f7c-1b3e72b55aa0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:11.696423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:11.697558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.697999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.698425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.699436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:11.700355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:11.702287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:11.724245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 891/1802] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:11.724967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:11.737703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46929602-3040-460a-a0a2-d072152fa500 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:11.744099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:11.745388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.745835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.746278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.747085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:11.749782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbefb07-ccf3-458e-9bd3-31c1dfc1d2d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:11.815367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780b291bfe5243e88f50b737cb151ac1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.816066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780b291bfe5243e88f50b737cb151ac1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.816768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780b291bfe5243e88f50b737cb151ac1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.834237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780b291bfe5243e88f50b737cb151ac1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.837957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 892/1803] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:11 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:11.843366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:11.843659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:11.843940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:11.847816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780b291bfe5243e88f50b737cb151ac1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:11.899599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:11.910812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 912/1804] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:11 2022] DELETE /identity/v3/users/780b291bfe5243e88f50b737cb151ac1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:11.910812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:11.913025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:11.917416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:12.102642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:12.147228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 893/1805] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 5 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:12.184618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45088bfe-b3dc-40f9-94cd-9db4275e5cde admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.199852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.200982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.201409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.201852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.202717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.204936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.252134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 913/1806] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:11 2022] POST /identity/v3/users => generated 283 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:12.256236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.271797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450be83-97f2-49f0-a059-61d25fccc947 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.276715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.277884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.278467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:12.279531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.280122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.280698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.282210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.284357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.309800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f589-c26a-4cdc-bee1-813637caf0d8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.315277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 894/1807] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:12.326252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.328261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.328261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.328261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.329068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.350798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.352341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.373160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1653-9cb9-4cbc-a29a-e4e3a8d4a458 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.387584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.389446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 914/1808] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:12.390225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.390330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.392194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.393966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.417229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa8a8-ccdc-4723-b5cf-4462910dc36f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.427148 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.431004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.444879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.446839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.449834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.450141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.450912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.457299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.457606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 895/1809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:12.489552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.491254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:12.505473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f0b4f-9784-4ac5-a46a-42e5c384b7b1 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.509862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 915/1810] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:12.511010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.529762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.530384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eca5-906e-4658-8d40-eba018cdb224 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:12.531348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.532247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.532560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.544172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:12.547255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.547952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.549562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] PATH_INFO: `/v3/projects/411b5728e66541319636faf16a185345/users/e63a3accb3a04c1b9c455b6c6627e9f7/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.569417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.578801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2717-d502-44bc-8f7b-6cf6fb0d00af service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.609468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 896/1811] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:12.614802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=411b5728e66541319636faf16a185345, user_id=e63a3accb3a04c1b9c455b6c6627e9f7, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:12.621751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:12.657526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 916/1812] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:12 2022] PUT /identity/v3/projects/411b5728e66541319636faf16a185345/users/e63a3accb3a04c1b9c455b6c6627e9f7/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:12.668532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:12.668840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:12.669109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:12.683232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:12.707496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] MFA Rules not processed for user `e63a3accb3a04c1b9c455b6c6627e9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:12.708769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:12.834762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:12.835082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 897/1813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:13.002904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05025-9065-4129-abe8-d025e7ef38ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.020397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.021947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.022237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.022452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.023920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.025945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.120646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.123226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:13.136554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 917/1814] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:12 2022] POST /identity/v3/projects => generated 365 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:13.138681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.153483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158c7f7-92d5-47f8-ab38-7cedf9e26556 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.280089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe27d96-c3ea-437c-b324-067c741f1589 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.293662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.294679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.295555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.295852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.296078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.296812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] PATH_INFO: `/v3/projects/6b1ed9a3576e43878d4c33e84937dffe` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.297084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.298740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1ed9a3576e43878d4c33e84937dffe)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.299892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.300928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.303147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.319076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:13.322829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.339787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 918/1815] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:13 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:13.343774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.362649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ec4db-d15f-41f0-a4c3-f96e22791d7b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.383221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.383952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.386192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.386480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.387473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.389657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.410722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 919/1816] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:13.413424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.466694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b60e0e-a096-49d2-b825-1b2880aa434b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.473161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.474207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.474499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.474982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] PATH_INFO: `/v3/projects/90e1b3233b114a93b18f2bbf19041d7f/users/bc85f2f5793a49eebc9e05cbefecc67a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.500322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e1b3233b114a93b18f2bbf19041d7f, user_id=bc85f2f5793a49eebc9e05cbefecc67a, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.503057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.518724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1ed9a3576e43878d4c33e84937dffe', 'request_id': 'req-5273eb6d-cfbd-4045-a602-d890fc3d8475'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:13.538187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 920/1817] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:13 2022] PUT /identity/v3/projects/90e1b3233b114a93b18f2bbf19041d7f/users/bc85f2f5793a49eebc9e05cbefecc67a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:13.539754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.544174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1ed9a3576e43878d4c33e84937dffe', 'request_id': 'req-5273eb6d-cfbd-4045-a602-d890fc3d8475'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:13.569050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1ed9a3576e43878d4c33e84937dffe', 'request_id': 'req-5273eb6d-cfbd-4045-a602-d890fc3d8475'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:13.613870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] The token cache is being invalidate because project 6b1ed9a3576e43878d4c33e84937dffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:13.614185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:13.622135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:13.624432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 898/1818] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:13 2022] DELETE /identity/v3/projects/6b1ed9a3576e43878d4c33e84937dffe => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:13.630395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.636325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:13.671256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c16dc-b111-48bb-b161-555f366448ca admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.679617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.680822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.681269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.681778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.683050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.686405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.706670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 921/1819] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:13.719166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:13.725560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:13.748880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:13.761734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9551f9-5d06-48e3-ad90-d7d540bbd055 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.775487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:13.777638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.778981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.780158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] PATH_INFO: `/v3/projects/90e1b3233b114a93b18f2bbf19041d7f/users/bc85f2f5793a49eebc9e05cbefecc67a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.789233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e1b3233b114a93b18f2bbf19041d7f, user_id=bc85f2f5793a49eebc9e05cbefecc67a, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:13.801114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052f2f-4f59-4215-9485-088f0feba2e1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:13.840523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 922/1820] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:13 2022] PUT /identity/v3/projects/90e1b3233b114a93b18f2bbf19041d7f/users/bc85f2f5793a49eebc9e05cbefecc67a/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:13.863004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:13.867530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:13.869875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:13.896057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273eb6d-cfbd-4045-a602-d890fc3d8475 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:13.952693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] MFA Rules not processed for user `bc85f2f5793a49eebc9e05cbefecc67a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:13.955243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:14.079269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:14.080638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:14.081138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:14.081636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] PATH_INFO: `/v3/users/212b8da5bd1a4de0b5f6a697e023e030` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:14.083358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=212b8da5bd1a4de0b5f6a697e023e030)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:14.087051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:14.104488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 923/1821] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:14.118402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:14.120036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:14.184149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212b8da5bd1a4de0b5f6a697e023e030'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:14.185910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212b8da5bd1a4de0b5f6a697e023e030'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:14.186555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212b8da5bd1a4de0b5f6a697e023e030'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:14.207758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212b8da5bd1a4de0b5f6a697e023e030'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:14.227930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212b8da5bd1a4de0b5f6a697e023e030'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:14.238883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:14.274281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 899/1822] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:13 2022] DELETE /identity/v3/users/212b8da5bd1a4de0b5f6a697e023e030 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:14.335273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed279-48cb-40d1-9718-ada71c7d9c12 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:14.493296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:14.494031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:14.494367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:14.494643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:14.497851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:14.614388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:14.618186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:14.653528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 924/1823] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:14.788435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:14.791382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:14.864554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12258-500f-470a-848d-5601fd910e9d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:14.873103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:14.874370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:14.874910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:14.875384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:14.879431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:15.026533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:15.093903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:15.095465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:15.124069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 900/1824] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:15.269559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:15.271554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:15.550334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:15.551892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:15.592891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6916bf-8e31-4624-a847-8457b6bf7f4b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:15.614836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f159-1bc7-4573-b442-f3ab04e70498 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:15.632709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:15.644164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:15.649580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:15.650781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] PATH_INFO: `/v3/projects/7b7142edf9db4cecb689fa2961109b1f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:15.656763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:15.657540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7142edf9db4cecb689fa2961109b1f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:15.657724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:15.658013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:15.658741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] PATH_INFO: `/v3/projects/e91ce586a70b422795acbf7f46b0fc79` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:15.661091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91ce586a70b422795acbf7f46b0fc79)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:15.664477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:15.671588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:15.836901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:15.866446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7142edf9db4cecb689fa2961109b1f', 'request_id': 'req-9345c7f7-be92-415a-9cc5-7f63364cd3e7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.883345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7142edf9db4cecb689fa2961109b1f', 'request_id': 'req-9345c7f7-be92-415a-9cc5-7f63364cd3e7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.884294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91ce586a70b422795acbf7f46b0fc79', 'request_id': 'req-fbd3381a-5879-4222-8bc4-0573083162b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.891452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7142edf9db4cecb689fa2961109b1f', 'request_id': 'req-9345c7f7-be92-415a-9cc5-7f63364cd3e7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.912020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91ce586a70b422795acbf7f46b0fc79', 'request_id': 'req-fbd3381a-5879-4222-8bc4-0573083162b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.919161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] The token cache is being invalidate because project 7b7142edf9db4cecb689fa2961109b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:15.919518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.920261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-9345c7f7-be92-415a-9cc5-7f63364cd3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.925590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 925/1825] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:15 2022] DELETE /identity/v3/projects/7b7142edf9db4cecb689fa2961109b1f => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:15.926211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91ce586a70b422795acbf7f46b0fc79', 'request_id': 'req-fbd3381a-5879-4222-8bc4-0573083162b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.937992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb65-e54e-4992-97ac-59a04813cea6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:15.938426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb65-e54e-4992-97ac-59a04813cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:15.939855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb65-e54e-4992-97ac-59a04813cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:15.971363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] The token cache is being invalidate because project e91ce586a70b422795acbf7f46b0fc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:15.971654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.975381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-fbd3381a-5879-4222-8bc4-0573083162b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:15.979071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 901/1826] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:15 2022] DELETE /identity/v3/projects/e91ce586a70b422795acbf7f46b0fc79 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:15.983946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cb7d-5337-4b75-8c44-100db96e0e10 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:15.984289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cb7d-5337-4b75-8c44-100db96e0e10 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:15.984553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cb7d-5337-4b75-8c44-100db96e0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:15.989696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7639fb65-e54e-4992-97ac-59a04813cea6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:15.990815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7639fb65-e54e-4992-97ac-59a04813cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:16.028069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2ef4cb7d-5337-4b75-8c44-100db96e0e10 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:16.034538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ef4cb7d-5337-4b75-8c44-100db96e0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:16.150793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 926/1827] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:16.159071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.159383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.159630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.216237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 902/1828] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:16.220833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.221214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.221409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.228899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:16.243399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:16.292776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 927/1829] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:16.296092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.309306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:16.310906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:16.337300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 903/1830] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:16.339382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550be53-2671-4e28-9127-3c2e0ee0c2ea None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.341208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.353140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.355336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.356658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.357210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.358026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:16.358345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.359038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37d97-67ae-494f-85e8-e5f41d4c32c3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.364423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.371632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.372971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.373451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.373965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.374902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:16.375411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.378209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.397809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 928/1831] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:16.402061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.419124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 904/1832] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:13:16.423047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.425869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907ab4b-f45c-48b7-93ff-99c9c22f2d52 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.431612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.432825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.433279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.433758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.435480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.439108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.453576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832704-3e63-42a7-8006-3aed2ab0a1cb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.464421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.466098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.470325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.471477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.472487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.478150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.541486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 929/1833] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:16.542977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.594166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 905/1834] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:16.598257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.677703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a112-c832-4cb7-b27c-c61b05068f8c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.725922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:16.743221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:16.840487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.842947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.843278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.843563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.848080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.856853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.858271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7183c2-7019-409a-9764-f827d25c3a97 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:16.876418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:16.880159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:16.880468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:16.880768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:16.900950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:16.913925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:16.958552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 930/1835] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/users => generated 297 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:16.961509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:16.998175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf295-4da0-4885-85ed-317ba9e588cc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.014718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.016266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.016575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.030298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 906/1836] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:16 2022] POST /identity/v3/users => generated 301 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:17.032875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.033319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.035516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.050529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.086107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ec09-ca5e-4567-ab3e-154694b3c17d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.104335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 931/1837] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:17.106413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.111640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.112600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.113194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.113587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.114465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.147666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.158413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca611169-ada3-4069-8a45-323a9975e020 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.183404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.184148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.184429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.184730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.189572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.191349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.213911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 907/1838] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:17.217778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.242822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 932/1839] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:17.247862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.266977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbac78d-2945-474f-8c41-0f85750a4dfe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.276995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04784ec5-a33d-42cb-86fa-781ebbf1edf2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.291573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.292554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.292837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.295141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] PATH_INFO: `/v3/projects/96a34893e2dc4db3b2a9f84aebeab646/users/42734f2e14724ae8918d5fa24d87662f/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.310444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.316305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.316305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.316305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.316305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.335911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63162-b2d2-4063-9e89-c55d6747aae4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.382298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a34893e2dc4db3b2a9f84aebeab646, user_id=42734f2e14724ae8918d5fa24d87662f, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.387694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 908/1840] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:17.388882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dd665-8914-427d-8797-f1b0e4160be0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.389366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beadd0-e297-454d-85b8-b1b440e7c9b5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.389659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beadd0-e297-454d-85b8-b1b440e7c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.389947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beadd0-e297-454d-85b8-b1b440e7c9b5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.391499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 909/1841] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:13:17.403128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beadd0-e297-454d-85b8-b1b440e7c9b5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.420944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 933/1842] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:17 2022] PUT /identity/v3/projects/96a34893e2dc4db3b2a9f84aebeab646/users/42734f2e14724ae8918d5fa24d87662f/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:17.436831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0e49-21db-4a1c-92e9-1a7ad667d701 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.440783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0e49-21db-4a1c-92e9-1a7ad667d701 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.441380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0e49-21db-4a1c-92e9-1a7ad667d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.532084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-075a0e49-21db-4a1c-92e9-1a7ad667d701 None None] MFA Rules not processed for user `42734f2e14724ae8918d5fa24d87662f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:17.537949 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-075a0e49-21db-4a1c-92e9-1a7ad667d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:17.592317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beadd0-e297-454d-85b8-b1b440e7c9b5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:17.610267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:17.611844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.612274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.612745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] PATH_INFO: `/v3/projects/3c37eab3be1e4f5996847d6fb2145b47/users/bcb96e3bf7e7428da8533314cb4610d0/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.667858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c37eab3be1e4f5996847d6fb2145b47, user_id=bcb96e3bf7e7428da8533314cb4610d0, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:17.672408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4abf92-94c3-4258-8b8a-54c57baef77c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:17.703565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 910/1843] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:17 2022] PUT /identity/v3/projects/3c37eab3be1e4f5996847d6fb2145b47/users/bcb96e3bf7e7428da8533314cb4610d0/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:17.705409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e0ff-c292-4d4b-adbc-c001c183387f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.709522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e0ff-c292-4d4b-adbc-c001c183387f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.709984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e0ff-c292-4d4b-adbc-c001c183387f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.711791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 911/1844] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:13:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:13:17.718112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.718563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.718977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.762465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:17.766572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:17.848060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 934/1845] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:17.853330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0c3b-6dd2-4d8b-9c89-dc519c6fe849 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:17.855204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0c3b-6dd2-4d8b-9c89-dc519c6fe849 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:17.855615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0c3b-6dd2-4d8b-9c89-dc519c6fe849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:17.965834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 912/1846] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:13:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:17.967768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-602d0c3b-6dd2-4d8b-9c89-dc519c6fe849 None None] MFA Rules not processed for user `bcb96e3bf7e7428da8533314cb4610d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:17.969677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:17.978863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-602d0c3b-6dd2-4d8b-9c89-dc519c6fe849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:18.041586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:18.118402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:18.138377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 935/1847] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:18.144897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.145543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.146026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.193773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:18.197489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:18.209857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bdb6-2065-4850-b5ad-55d45a04c5c3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.215787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 936/1848] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:13:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:18.217815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.222068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.222714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.223003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.223280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.223997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.226033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.233712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f11bca-0d30-46d9-9123-9d388257df1a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.239069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.239775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.240057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.240331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.241486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.244823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.283205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 937/1849] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:18 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:18.293639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.310515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 913/1850] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:17 2022] POST /identity/v3/projects => generated 393 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:18.313702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.509948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c49e7-6c26-4333-9399-b08d0eb429c0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.522690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.523878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.524214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.525059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.526523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.528911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.549046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208aa8-1828-4323-a37f-5475686096d9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.562757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 914/1851] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:18 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:18.564187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.569230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.570426 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.570642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.570940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.571628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.578769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.579159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcb52-98df-477b-b4de-450bcced4e5c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.587644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.589025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.589516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.590025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.590979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.592989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.612269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 915/1852] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:18.614644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.633571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 938/1853] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:18 2022] POST /identity/v3/users => generated 306 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:18.636113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34c26-1e3f-481e-8d5d-063c1487f061 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.636234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.643295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.644981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.645374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.645761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] PATH_INFO: `/v3/projects/32de8993fae640e080de6fafb5c6e97e/users/26aa56db42c645c68cf820ee0c80518b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.660316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840a115-e590-4851-ad83-cd1c982b1ebe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.676723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.678399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.680770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.682525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.685427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.686043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32de8993fae640e080de6fafb5c6e97e, user_id=26aa56db42c645c68cf820ee0c80518b, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.690211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.691634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.726181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 916/1854] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:18 2022] PUT /identity/v3/projects/32de8993fae640e080de6fafb5c6e97e/users/26aa56db42c645c68cf820ee0c80518b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:18.727616 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.732857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 939/1855] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:18.738244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:18.772879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080d91-2054-48b5-9f53-cdbccf5eef2d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.907188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:18.919006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabab8e-f73f-476a-a32e-88fd030476f8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:18.934219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.937279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.937770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.937972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.939679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:18.955324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:18.956197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:18.956468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:18.956799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] PATH_INFO: `/v3/projects/18e93e44f21341d3970eaed604c76eb0/users/93c96bdfdf1a4969a11331d461576369/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:18.963771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:18.996869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e93e44f21341d3970eaed604c76eb0, user_id=93c96bdfdf1a4969a11331d461576369, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:19.003549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 917/1856] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:19.006120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.008663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:19.036175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f93d25-c50e-4bd4-be05-d80257214e60 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:19.046804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 940/1857] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:18 2022] PUT /identity/v3/projects/18e93e44f21341d3970eaed604c76eb0/users/93c96bdfdf1a4969a11331d461576369/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:19.060700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.175309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:19.241401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:19.245404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:19.245707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:19.246000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] PATH_INFO: `/v3/projects/32de8993fae640e080de6fafb5c6e97e/users/26aa56db42c645c68cf820ee0c80518b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:19.257341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32de8993fae640e080de6fafb5c6e97e, user_id=26aa56db42c645c68cf820ee0c80518b, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:19.270808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb750394-1228-4e49-9a12-10d8e9b1c32a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:19.299095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d8100-dce8-4a64-8e07-98324a8db008 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:19.317959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 918/1858] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:19 2022] PUT /identity/v3/projects/32de8993fae640e080de6fafb5c6e97e/users/26aa56db42c645c68cf820ee0c80518b/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:19.331428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:19.331623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:19.332105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:19.420310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] MFA Rules not processed for user `26aa56db42c645c68cf820ee0c80518b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:19.424708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:19.469917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:19.471769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:19.472289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:19.477555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:19.481031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:19.484089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:19.525851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 941/1859] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:19.531688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.536214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:19.587266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc480-104e-4919-a225-268d4f48919e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:19.600158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:19.602787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:19.603073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:19.603358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] PATH_INFO: `/v3/users/e63a3accb3a04c1b9c455b6c6627e9f7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:19.607710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63a3accb3a04c1b9c455b6c6627e9f7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:19.613130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:19.660734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 919/1860] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:19.661647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.682679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb55bd-5728-4d1b-8f5e-31086d28c7f8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:19.709407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:19.710797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:19.711717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:19.712178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] PATH_INFO: `/v3/projects/18e93e44f21341d3970eaed604c76eb0/users/93c96bdfdf1a4969a11331d461576369/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:19.724523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e93e44f21341d3970eaed604c76eb0, user_id=93c96bdfdf1a4969a11331d461576369, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:19.730832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63a3accb3a04c1b9c455b6c6627e9f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:19.733029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63a3accb3a04c1b9c455b6c6627e9f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:19.734859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63a3accb3a04c1b9c455b6c6627e9f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:19.736551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:19.751532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 920/1861] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:19 2022] PUT /identity/v3/projects/18e93e44f21341d3970eaed604c76eb0/users/93c96bdfdf1a4969a11331d461576369/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:19.752611 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63a3accb3a04c1b9c455b6c6627e9f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:19.752924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.754990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:19.771819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63a3accb3a04c1b9c455b6c6627e9f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:19.807877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 942/1862] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:19 2022] DELETE /identity/v3/users/e63a3accb3a04c1b9c455b6c6627e9f7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:19.809361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:19.814570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:19.930121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae927-2046-4a78-911e-2882e13c9228 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:19.940103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:20.006195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:20.028486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce724a-da1f-43c5-967e-e1a6cb64bf0f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.042788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.043993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.044474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.045085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.053333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.093193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.098211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e78b2e-b300-43a8-8c61-aa1cae4003d1 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:20.151635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 943/1863] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:20.156749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02438cdd-24fb-4043-a5bf-5fe5f9079b3e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.159194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02438cdd-24fb-4043-a5bf-5fe5f9079b3e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.159846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02438cdd-24fb-4043-a5bf-5fe5f9079b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.190967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.191652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.191937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.192578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.195817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.258869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-02438cdd-24fb-4043-a5bf-5fe5f9079b3e None None] MFA Rules not processed for user `93c96bdfdf1a4969a11331d461576369`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:20.260319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-02438cdd-24fb-4043-a5bf-5fe5f9079b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.401825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.403580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:20.427327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 944/1864] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:20.427327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.427327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.427327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.448260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 921/1865] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:20.452958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:20.460386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.475905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:20.481053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.513594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d4f5-e9fc-4691-b3d7-1c90e871d0b1 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.527994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.528802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.529156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.529480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.536822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.559947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.561919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:20.589180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 922/1866] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:20.590391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:20.595689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.602262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 945/1867] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:20.603206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:20.614482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ec18-6025-49a7-9182-0425ed6054f7 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.619002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.620012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.620368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.620790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.628781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9183a9-bcf2-45fb-9dec-037cf489d56a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.631694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.633511 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:20.642357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.643262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.643559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.643862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.650369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 923/1868] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:20.650966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.715918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:20.717365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.827980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:20.847137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.849404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:20.876885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 946/1869] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:20.878079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:20.895402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423d6c-c3fc-46d0-82c2-e67964cf4206 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.907049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.909073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.909363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.909641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.916208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:20.944423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933107-93a1-4c1a-b771-dd480f35f427 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:20.956393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:20.960678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:20.961378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:20.962594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:20.994545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:20.997925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:21.030352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 924/1870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:21.097401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:21.099085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:21.110364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 947/1871] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:21.685694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:21.687242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:21.701536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb52c56-95c6-4980-81a0-1d6574c59377 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:21.707250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:21.708084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:21.708457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:21.708811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] PATH_INFO: `/v3/projects/411b5728e66541319636faf16a185345` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:21.710049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=411b5728e66541319636faf16a185345)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:21.712163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:21.750842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:21.761615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411b5728e66541319636faf16a185345', 'request_id': 'req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.767242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411b5728e66541319636faf16a185345', 'request_id': 'req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.775597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411b5728e66541319636faf16a185345', 'request_id': 'req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.786894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] The token cache is being invalidate because project 411b5728e66541319636faf16a185345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:21.787181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.787810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.789448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 925/1872] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:21 2022] DELETE /identity/v3/projects/411b5728e66541319636faf16a185345 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:21.793539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:21.804468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6cb6e-b2a6-4055-82fb-b68203cae65b service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:21.863126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:21.864025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:21.864310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:21.864632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] PATH_INFO: `/v3/users/bc85f2f5793a49eebc9e05cbefecc67a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:21.865847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc85f2f5793a49eebc9e05cbefecc67a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:21.867904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:21.915239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc85f2f5793a49eebc9e05cbefecc67a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.915872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc85f2f5793a49eebc9e05cbefecc67a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.916478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc85f2f5793a49eebc9e05cbefecc67a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.923258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc85f2f5793a49eebc9e05cbefecc67a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.933417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b20e0c68-fe34-46d7-953a-65d76823c985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc85f2f5793a49eebc9e05cbefecc67a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:21.952888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 948/1873] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:21 2022] DELETE /identity/v3/users/bc85f2f5793a49eebc9e05cbefecc67a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:22.296982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:22.298609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:22.312970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cea61-2602-4eed-b0e0-1cebaa70e9ff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:22.404236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:22.405182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.405502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.405779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] PATH_INFO: `/v3/projects/90e1b3233b114a93b18f2bbf19041d7f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.407050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e1b3233b114a93b18f2bbf19041d7f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:22.409101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:22.474258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e1b3233b114a93b18f2bbf19041d7f', 'request_id': 'req-eab93017-b859-40d5-a290-4b0ea194e0f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:22.489251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e1b3233b114a93b18f2bbf19041d7f', 'request_id': 'req-eab93017-b859-40d5-a290-4b0ea194e0f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:22.500702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e1b3233b114a93b18f2bbf19041d7f', 'request_id': 'req-eab93017-b859-40d5-a290-4b0ea194e0f0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:22.513868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] The token cache is being invalidate because project 90e1b3233b114a93b18f2bbf19041d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:22.514160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:22.514814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-eab93017-b859-40d5-a290-4b0ea194e0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:22.516529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 926/1874] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:22 2022] DELETE /identity/v3/projects/90e1b3233b114a93b18f2bbf19041d7f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:22.522725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.523025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.523298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.540794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:22.542009 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:22.546906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:22.614093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 949/1875] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:22.622153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6508-ef60-468a-833e-91a735321237 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.622479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6508-ef60-468a-833e-91a735321237 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.622762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6508-ef60-468a-833e-91a735321237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.643492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-93ee6508-ef60-468a-833e-91a735321237 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:22.644708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93ee6508-ef60-468a-833e-91a735321237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:22.658693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 927/1876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:22.663460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:22.678435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c06df-7a7d-4262-94c7-08a46ee7359b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:22.685428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:22.686117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.686396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.686671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.687403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:22.688000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:22.690731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:22.708993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 950/1877] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:22.713585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee6508-ef60-468a-833e-91a735321237 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:22.730293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee6508-ef60-468a-833e-91a735321237 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:22.736902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:22.738459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.739279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.739773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.740701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:22.744201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:22.808859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 928/1878] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:22.813240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:22.832695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30000bc-0e2c-4ae1-b10c-22648d3b7c1a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:22.917752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:22.918557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:22.918842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:22.919116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:22.919809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:22.921928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:22.974331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 951/1879] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:22 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:22.975871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:22.991161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41176-d445-4bd9-b658-821a761f612f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.005557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.006350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.013048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.013635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.014627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.016503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.044602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 929/1880] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:23.049536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.066250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5487a2-1bbf-4f6e-9980-c860e99dec67 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.073005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.074314 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.076430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.077120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.078618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.081931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb938-ceb0-432b-bd85-c6fe1a310cd7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.102979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 952/1881] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:23.108390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.125307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033383f-39ce-49ad-a1e2-2f974b221b43 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.136069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.137216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.137530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.137819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] PATH_INFO: `/v3/projects/5f818920c60844c4814f6269ef6c0515/users/6a1f353b7d86405e861183e5202e00ea/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.158315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:23.180642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f818920c60844c4814f6269ef6c0515, user_id=6a1f353b7d86405e861183e5202e00ea, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.185240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.221209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 930/1882] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:23 2022] PUT /identity/v3/projects/5f818920c60844c4814f6269ef6c0515/users/6a1f353b7d86405e861183e5202e00ea/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:23.224921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.225212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.225493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.284496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] MFA Rules not processed for user `6a1f353b7d86405e861183e5202e00ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:23.288350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:23.422111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 953/1883] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:23.427516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.516396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88bbb4-d7f3-47c9-8b64-85fad26ada79 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.524642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.524642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.524642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.524642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.524955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.526501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.562580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.569065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 931/1884] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:23 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:23.570555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:23.576632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7dd0-eb61-45fa-8dc3-93525b867898 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.648740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.649578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.649862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.650135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.650843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.652878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.680654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 954/1885] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:23 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:23.681572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.693212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef39d-25b4-4d4d-9e44-83cf69753c45 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.698239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.698988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.699273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.699551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.700322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.702326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.719107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.724351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 932/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:23.729654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dd93-e8c2-4180-a8fd-bca5ca0d4084 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.735091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.736032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.736309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.736626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] PATH_INFO: `/v3/projects/713ebd70554d408eaa28735e74632b5b/users/813c396fd9d448c58797082b62447732/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.753738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=713ebd70554d408eaa28735e74632b5b, user_id=813c396fd9d448c58797082b62447732, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.756695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.773135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 955/1887] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:23 2022] PUT /identity/v3/projects/713ebd70554d408eaa28735e74632b5b/users/813c396fd9d448c58797082b62447732/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:23.778011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.793751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9652-3340-43f4-9d74-44329555b492 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.873247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.873923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.874188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.874531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.875358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.877042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602435c-47b9-437b-b6a7-40ef4904bc7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.888963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 933/1888] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:23.893046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:23.907311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1bce-f7b3-42f5-b55a-70d1eafab4af admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:23.912810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:23.914022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.914214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.914662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] PATH_INFO: `/v3/projects/713ebd70554d408eaa28735e74632b5b/users/813c396fd9d448c58797082b62447732/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.917063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713ebd70554d408eaa28735e74632b5b, user_id=813c396fd9d448c58797082b62447732, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:23.920005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:23.931208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 956/1889] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:23 2022] PUT /identity/v3/projects/713ebd70554d408eaa28735e74632b5b/users/813c396fd9d448c58797082b62447732/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:23.943568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:23.943877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:23.944134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:23.978740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] MFA Rules not processed for user `813c396fd9d448c58797082b62447732`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:23.980212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:24.030932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:24.054543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 934/1890] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:24.066159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:24.068317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:24.125490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930905a-4747-4053-8a5d-14bb2bd8d664 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:24.129465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:24.130115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:24.130375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:24.130650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:24.140852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:24.142221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420934aa-3d01-412d-8d76-1462c87d7641 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:24.152431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 957/1891] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:24.791686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:24.867477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494056ee-24f9-4699-ba48-4100123463d7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:24.880100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:24.882348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:24.883390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:24.883908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] PATH_INFO: `/v3/users/6a1f353b7d86405e861183e5202e00ea` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:24.885859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1f353b7d86405e861183e5202e00ea)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:24.888637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:24.960333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1f353b7d86405e861183e5202e00ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:24.961441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1f353b7d86405e861183e5202e00ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:24.962861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1f353b7d86405e861183e5202e00ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:24.978730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1f353b7d86405e861183e5202e00ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:24.994577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1f353b7d86405e861183e5202e00ea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.025462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 935/1892] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:24 2022] DELETE /identity/v3/users/6a1f353b7d86405e861183e5202e00ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:25.030796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.031281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.031374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.051080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:25.052320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.113841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:25.124915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 958/1893] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:25.134922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.136552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.213957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7d27-0dec-4308-97fb-5152a8397847 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.218844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.219644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.219991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.220647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.232634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.234849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f41a9b-c119-49d6-b4f6-f00c82d3f7de service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.248498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 936/1894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:25.290816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.292336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.305212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e306c-f479-464e-bcc8-5d20af7e9d5a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.310694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.311592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.311874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.312171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] PATH_INFO: `/v3/users/42734f2e14724ae8918d5fa24d87662f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.313564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42734f2e14724ae8918d5fa24d87662f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.315782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.371349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42734f2e14724ae8918d5fa24d87662f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.372371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42734f2e14724ae8918d5fa24d87662f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.373349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42734f2e14724ae8918d5fa24d87662f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.382288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42734f2e14724ae8918d5fa24d87662f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.393212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42734f2e14724ae8918d5fa24d87662f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.414423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 959/1895] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:25 2022] DELETE /identity/v3/users/42734f2e14724ae8918d5fa24d87662f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:25.418727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.419049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.419310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.433301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:25.439855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:25.442676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.525127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 937/1896] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:25.535790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.537267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.552879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.554976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.567662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aad5a-309c-4be6-a786-5730ed409c5a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.572923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.573832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.574113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.574416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] PATH_INFO: `/v3/projects/5f818920c60844c4814f6269ef6c0515` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.575607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f818920c60844c4814f6269ef6c0515)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.577581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.607321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9f671-f9bd-442f-9d29-a97885a3ac1e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.612670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.613385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.613696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.614067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.624764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.626222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.633668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f818920c60844c4814f6269ef6c0515', 'request_id': 'req-483f15dd-80ab-4211-bd2b-4b7a544cd374'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.636274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 960/1897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:25.640479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f818920c60844c4814f6269ef6c0515', 'request_id': 'req-483f15dd-80ab-4211-bd2b-4b7a544cd374'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.649280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f818920c60844c4814f6269ef6c0515', 'request_id': 'req-483f15dd-80ab-4211-bd2b-4b7a544cd374'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.663658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] The token cache is being invalidate because project 5f818920c60844c4814f6269ef6c0515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:25.664183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.664926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.666861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 938/1898] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:25 2022] DELETE /identity/v3/projects/5f818920c60844c4814f6269ef6c0515 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:25.671453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.682433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5b42-9cbd-4cb0-b592-a730ba85a076 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.754721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.755921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.756207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.756524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] PATH_INFO: `/v3/users/813c396fd9d448c58797082b62447732` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.759040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813c396fd9d448c58797082b62447732)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.761538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.784844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:25.843651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:25.845879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:25.861004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813c396fd9d448c58797082b62447732'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.861928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813c396fd9d448c58797082b62447732'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.862336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813c396fd9d448c58797082b62447732'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.868745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f15dd-80ab-4211-bd2b-4b7a544cd374 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:25.871649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813c396fd9d448c58797082b62447732'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.876768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:25.878053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:25.878945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:25.879437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] PATH_INFO: `/v3/users/bcb96e3bf7e7428da8533314cb4610d0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:25.881643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb96e3bf7e7428da8533314cb4610d0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:25.883534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813c396fd9d448c58797082b62447732'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:25.885508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:25.904290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 961/1899] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:25 2022] DELETE /identity/v3/users/813c396fd9d448c58797082b62447732 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:26.037314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb96e3bf7e7428da8533314cb4610d0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.051611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb96e3bf7e7428da8533314cb4610d0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.052800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.053302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb96e3bf7e7428da8533314cb4610d0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.055590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.063556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb96e3bf7e7428da8533314cb4610d0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.098765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4bf5882a-980f-40d3-9a89-a1e2525a40ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb96e3bf7e7428da8533314cb4610d0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.135142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 939/1900] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:25 2022] DELETE /identity/v3/users/bcb96e3bf7e7428da8533314cb4610d0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:26.136840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e262-a487-4347-99fd-62e95121d84e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.137035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e262-a487-4347-99fd-62e95121d84e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.137332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209e262-a487-4347-99fd-62e95121d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.154380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:26.177118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9209e262-a487-4347-99fd-62e95121d84e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:26.178907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fc9a-b317-4f5d-8d5c-72cb75eb03f8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.180299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9209e262-a487-4347-99fd-62e95121d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.322400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.323316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.323594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.323866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] PATH_INFO: `/v3/projects/96a34893e2dc4db3b2a9f84aebeab646` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.327476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a34893e2dc4db3b2a9f84aebeab646)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.330227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.344569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 940/1901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:26.381121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209e262-a487-4347-99fd-62e95121d84e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.384386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9209e262-a487-4347-99fd-62e95121d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.417283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:26.422546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a34893e2dc4db3b2a9f84aebeab646', 'request_id': 'req-7dda38d0-544f-452f-8760-e54f9d0d142b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.436225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a34893e2dc4db3b2a9f84aebeab646', 'request_id': 'req-7dda38d0-544f-452f-8760-e54f9d0d142b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.444984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a34893e2dc4db3b2a9f84aebeab646', 'request_id': 'req-7dda38d0-544f-452f-8760-e54f9d0d142b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.475749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] The token cache is being invalidate because project 96a34893e2dc4db3b2a9f84aebeab646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:26.476825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.478863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.483431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 962/1902] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:26 2022] DELETE /identity/v3/projects/96a34893e2dc4db3b2a9f84aebeab646 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:26.484775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.487436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.515038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209e262-a487-4347-99fd-62e95121d84e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.594845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda38d0-544f-452f-8760-e54f9d0d142b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.607022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.607898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.608183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.608477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] PATH_INFO: `/v3/projects/713ebd70554d408eaa28735e74632b5b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.610204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713ebd70554d408eaa28735e74632b5b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.612165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.613241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.615368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.615663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.615956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.618031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.636713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.638186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.651574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 941/1903] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:26.652419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.654315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.669622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f836-ee34-4415-88dc-027ace32e6bf service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.672629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713ebd70554d408eaa28735e74632b5b', 'request_id': 'req-a0ad29aa-d03f-4694-a77f-726e71cdb859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.680714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713ebd70554d408eaa28735e74632b5b', 'request_id': 'req-a0ad29aa-d03f-4694-a77f-726e71cdb859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.694359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713ebd70554d408eaa28735e74632b5b', 'request_id': 'req-a0ad29aa-d03f-4694-a77f-726e71cdb859'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.714834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] The token cache is being invalidate because project 713ebd70554d408eaa28735e74632b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:26.715124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.715805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a0ad29aa-d03f-4694-a77f-726e71cdb859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.718158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 963/1904] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:26 2022] DELETE /identity/v3/projects/713ebd70554d408eaa28735e74632b5b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:26.723844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610ea6-6a52-4632-9010-5e879fdeda28 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.724341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610ea6-6a52-4632-9010-5e879fdeda28 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.726250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610ea6-6a52-4632-9010-5e879fdeda28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.757317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-10610ea6-6a52-4632-9010-5e879fdeda28 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:26.758905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10610ea6-6a52-4632-9010-5e879fdeda28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.762997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.763993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.764284 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.764590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] PATH_INFO: `/v3/users/26aa56db42c645c68cf820ee0c80518b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.766627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aa56db42c645c68cf820ee0c80518b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.769956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.772937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:26.777989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 964/1905] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:26.779249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.779635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.780018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.801764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:26.802998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.812685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 965/1906] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:26.817622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.828884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae569e-955a-4e43-86ed-fad519742c28 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.833757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.834574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.834860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.835163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.835898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:26.836248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.838560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.839352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aa56db42c645c68cf820ee0c80518b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.839764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aa56db42c645c68cf820ee0c80518b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.840473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aa56db42c645c68cf820ee0c80518b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.848427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aa56db42c645c68cf820ee0c80518b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.855890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 966/1907] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:13:26.857027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:26.859400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:26.862440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aa56db42c645c68cf820ee0c80518b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:26.878645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cdf2a-fb04-47f0-a4c7-42a258b3a0db admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:26.885396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:26.885888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:26.886298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:26.886587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:26.888244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:26.890667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:26.895636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 942/1908] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:26 2022] DELETE /identity/v3/users/26aa56db42c645c68cf820ee0c80518b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:26.949404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 967/1909] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:26 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:26.950647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.048752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8925-6b80-4b65-8db8-5e968fe81f50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.068653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.072468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.095152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:27.157400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009599-96ec-4b8f-bab4-3169f72543c6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.157618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.158361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.158653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.158935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.159722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.162145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.164947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.166018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.166903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.167351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] PATH_INFO: `/v3/projects/3c37eab3be1e4f5996847d6fb2145b47` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.170270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c37eab3be1e4f5996847d6fb2145b47)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.172815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.191473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 943/1910] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:26 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:27.196008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.210031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fbecc-1779-4e16-8033-c1ae7a32f295 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.217231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.218770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.219166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.219690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.221047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.222875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.238355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 944/1911] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:27.238355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.238612 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.242775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c37eab3be1e4f5996847d6fb2145b47', 'request_id': 'req-addeecce-411f-48f1-9577-dd41c4def79f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.250087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c37eab3be1e4f5996847d6fb2145b47', 'request_id': 'req-addeecce-411f-48f1-9577-dd41c4def79f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.257401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c37eab3be1e4f5996847d6fb2145b47', 'request_id': 'req-addeecce-411f-48f1-9577-dd41c4def79f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.258914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3c07-ad5e-4d15-9fd9-06441f2066b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.265919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:27.274554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] The token cache is being invalidate because project 3c37eab3be1e4f5996847d6fb2145b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:27.274910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.275494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.281161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 968/1912] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:27 2022] DELETE /identity/v3/projects/3c37eab3be1e4f5996847d6fb2145b47 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:27.281161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.281161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.339396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.341809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.342602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.343306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] PATH_INFO: `/v3/projects/32de8993fae640e080de6fafb5c6e97e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.345915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32de8993fae640e080de6fafb5c6e97e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.348064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.356340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeecce-411f-48f1-9577-dd41c4def79f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.362191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.362944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.363223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.363500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.364814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.366638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.379387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 969/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:27.380333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.384587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.400796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a37d-0aae-4096-bfee-5569436ff04d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.422266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32de8993fae640e080de6fafb5c6e97e', 'request_id': 'req-9927f65a-3a11-4786-aa85-3ee265367d65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.429508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32de8993fae640e080de6fafb5c6e97e', 'request_id': 'req-9927f65a-3a11-4786-aa85-3ee265367d65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.439859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32de8993fae640e080de6fafb5c6e97e', 'request_id': 'req-9927f65a-3a11-4786-aa85-3ee265367d65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.452799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:27.454716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] The token cache is being invalidate because project 32de8993fae640e080de6fafb5c6e97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:27.454972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.457466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.459108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 945/1914] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:27 2022] DELETE /identity/v3/projects/32de8993fae640e080de6fafb5c6e97e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:27.461383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.465349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.484841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.487655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.487961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.488260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] PATH_INFO: `/v3/users/93c96bdfdf1a4969a11331d461576369` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.500205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c96bdfdf1a4969a11331d461576369)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.500205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.544555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c96bdfdf1a4969a11331d461576369'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.545226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c96bdfdf1a4969a11331d461576369'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.545841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c96bdfdf1a4969a11331d461576369'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.551523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927f65a-3a11-4786-aa85-3ee265367d65 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.552737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c96bdfdf1a4969a11331d461576369'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.556626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.557604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.557976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.558428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] PATH_INFO: `/v3/projects/606e6d07d3084e5fb4f5a2a45f1c0406/users/790a6a5ecd4348b39d6037020b9270b7/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.562129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1467854e-45b6-4885-9472-a54a5b6f3abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c96bdfdf1a4969a11331d461576369'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:27.575516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606e6d07d3084e5fb4f5a2a45f1c0406, user_id=790a6a5ecd4348b39d6037020b9270b7, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.578357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1911cf-ad8a-47fe-ad4b-ebfa439398f5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.579850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 970/1915] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:27 2022] DELETE /identity/v3/users/93c96bdfdf1a4969a11331d461576369 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:27.584882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b878-0c3a-4465-91e4-41e8533194ee None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.585394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b878-0c3a-4465-91e4-41e8533194ee None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.585718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b878-0c3a-4465-91e4-41e8533194ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.604953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 946/1916] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:27 2022] PUT /identity/v3/projects/606e6d07d3084e5fb4f5a2a45f1c0406/users/790a6a5ecd4348b39d6037020b9270b7/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:27.606958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ce24b878-0c3a-4465-91e4-41e8533194ee None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:27.608956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ce24b878-0c3a-4465-91e4-41e8533194ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.620418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.620418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.620418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.674466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] MFA Rules not processed for user `790a6a5ecd4348b39d6037020b9270b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:27.676065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.687204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:27.697188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 971/1917] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:27.706583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.707402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.707402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.738232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:27.739571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.756156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 972/1918] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:27.757351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.770355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e11ef-b89b-41ea-b293-c639378a58bd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.776829 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.777688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.778203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.779631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.780561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:27.781060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.783279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.802757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 973/1919] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:27.808295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.822729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d04a1-7ffe-4b5c-a018-151f3ad9cd9f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:27.833947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:27.834821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:27.835237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:27.835648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:27.836613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:27.839228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:27.877515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 947/1920] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:27.880765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 974/1921] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:27 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:27.894268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.897769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:27.899919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:27.924078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:27.945775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d199c30-5946-453f-bbfa-8bd93127b4e7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.007209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f983815-a691-4dac-a1a2-4ff3b5cb5314 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.016180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.019870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.020248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.020660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.065597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.066310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.066590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.066861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.078448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.080515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.129355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 948/1922] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:27 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:28.133356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.151058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.154452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.159496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb60d5-d911-47de-b4b9-b10cdf6175db admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.169696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 975/1923] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:28.175539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.178871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.180917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.181704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.182777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.187094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.202152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 949/1924] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:28.206037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.221288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d784-7a4a-4399-bce6-7845969b8969 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.228158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.229298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.229531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.230472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.231506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.233734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.260984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 976/1925] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:28.266358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.281526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dcb-616e-4160-b24d-489625b81186 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.290356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.292665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.293330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.298285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] PATH_INFO: `/v3/projects/687ef80b34fd42de8cd021b0256ebe0c/users/5e7e16e80a594d7d9c942d372b5f3881/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.324378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.326396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:28.340381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687ef80b34fd42de8cd021b0256ebe0c, user_id=5e7e16e80a594d7d9c942d372b5f3881, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.344060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace99c87-09a4-4db2-aa03-1ecf8aa3c277 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.368665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 950/1926] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:28 2022] PUT /identity/v3/projects/687ef80b34fd42de8cd021b0256ebe0c/users/5e7e16e80a594d7d9c942d372b5f3881/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:28.379205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.379602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.379950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.383102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a2d4-478c-4cdb-b126-ee5fbc67c938 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.418628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] MFA Rules not processed for user `5e7e16e80a594d7d9c942d372b5f3881`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:28.421083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:28.463379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.464291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.464582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.464871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] PATH_INFO: `/v3/projects/18e93e44f21341d3970eaed604c76eb0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.466094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e93e44f21341d3970eaed604c76eb0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.468030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.494825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:28.521837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 951/1927] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:28.526458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.532229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e93e44f21341d3970eaed604c76eb0', 'request_id': 'req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:28.538971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e93e44f21341d3970eaed604c76eb0', 'request_id': 'req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:28.545848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e93e44f21341d3970eaed604c76eb0', 'request_id': 'req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:28.547828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:28.558723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94df40f-52d2-4532-91e8-602f8b30f0b2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.573357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] The token cache is being invalidate because project 18e93e44f21341d3970eaed604c76eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:28.573661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:28.577247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ed80f5ca-3a68-49d8-b0d9-de2578b874cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:28.579152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 977/1928] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:28 2022] DELETE /identity/v3/projects/18e93e44f21341d3970eaed604c76eb0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:28.587628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819c1-8218-4ffe-a7c8-26afcad6f1f0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.587919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819c1-8218-4ffe-a7c8-26afcad6f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.588215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819c1-8218-4ffe-a7c8-26afcad6f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.610180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-867819c1-8218-4ffe-a7c8-26afcad6f1f0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:28.611430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-867819c1-8218-4ffe-a7c8-26afcad6f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:28.655770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.656717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.657151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.657736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.658596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.661577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.695515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 978/1929] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:28.696958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 952/1930] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:28.703173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.703477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.703850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.705700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.709559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:28.734173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:28.744117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:28.810808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555943e3-3582-45e9-afbe-7aa9b402876d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.815797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.816564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.816855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.817578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.818498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.820867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.843866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 953/1931] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:28.844403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 979/1932] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:28.847676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.850551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.858283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cc2cb-76ca-4997-b3d3-a7d70f43a9b6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.860077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ebba-8e89-462f-843a-6c8ec67f83cd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.864579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.865234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.865570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.865909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.866062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.866256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.866540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.866628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.867307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:28.867524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.867624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.869253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.869400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.880470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 954/1933] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:28.883395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 980/1934] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:13:28.885792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.889738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.896133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6a40-d5a0-4c45-802d-3874f204399e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.900429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edac9-b4ed-4e62-a17b-c44bd2cbada3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:28.901235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.902231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.902914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.903350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] PATH_INFO: `/v3/projects/6460136c0c474d6c8195143efaddea04/users/2b61b010209b4680ab19dec88bb9222f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.905847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:28.906488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:28.906839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:28.907294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:28.907914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.909955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.920211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6460136c0c474d6c8195143efaddea04, user_id=2b61b010209b4680ab19dec88bb9222f, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:28.923318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:28.940499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 981/1935] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:28.943471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.948034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 955/1936] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:28 2022] PUT /identity/v3/projects/6460136c0c474d6c8195143efaddea04/users/2b61b010209b4680ab19dec88bb9222f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:28.950159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:28.989091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:29.015353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:29.019528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecadd5-a246-4bb1-a285-a1fa3905a02d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.020726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067906a-1e60-4df6-9823-cd719165d447 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.026632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.027426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.027706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.027983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.028171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.028757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.029581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.030339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.030462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.031094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.031917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.034116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.053008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 956/1937] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:29.058297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.066335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 982/1938] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:28 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:29.073533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.075481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf2b1-ddef-4a2d-9371-1fc75311de6d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.081665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.082631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.082915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.083194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] PATH_INFO: `/v3/projects/6460136c0c474d6c8195143efaddea04/users/2b61b010209b4680ab19dec88bb9222f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.086681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6460136c0c474d6c8195143efaddea04, user_id=2b61b010209b4680ab19dec88bb9222f, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.090040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34446ad-56d9-4328-b2df-76b298fcbf63 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.094948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f610-a175-436a-b767-1d331f71023a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.100043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.101119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.101508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.101867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.102680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.106293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.121391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 983/1939] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:29.122603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.141621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 957/1940] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:29 2022] PUT /identity/v3/projects/6460136c0c474d6c8195143efaddea04/users/2b61b010209b4680ab19dec88bb9222f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:29.141906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715ed19-6209-421b-aaff-3b0bbcd3da10 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.143455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa7e64-a668-4bbf-8f24-37c6b11c6043 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.143749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa7e64-a668-4bbf-8f24-37c6b11c6043 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.144037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa7e64-a668-4bbf-8f24-37c6b11c6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.187897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-55aa7e64-a668-4bbf-8f24-37c6b11c6043 None None] MFA Rules not processed for user `2b61b010209b4680ab19dec88bb9222f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:29.189330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-55aa7e64-a668-4bbf-8f24-37c6b11c6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:29.243479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.245286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.245667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.246241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.247327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.249440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12bddf-7e6b-48a4-aacd-abd9a713ec4e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.263793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 984/1941] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:29.270893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57966-2746-485d-9562-cd72dc536652 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.271304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57966-2746-485d-9562-cd72dc536652 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.272033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57966-2746-485d-9562-cd72dc536652 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.274141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 985/1942] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:13:29.275040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57966-2746-485d-9562-cd72dc536652 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.283912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 958/1943] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:29.285500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fedc6-242b-42e2-85c8-8ff51b5cef57 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.285846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fedc6-242b-42e2-85c8-8ff51b5cef57 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.286132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fedc6-242b-42e2-85c8-8ff51b5cef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.304915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57966-2746-485d-9562-cd72dc536652 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.314992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.316068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.316419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.316788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] PATH_INFO: `/v3/projects/9ef69ab5fd1f4117997b79647a2435e3/users/7b1dd40fe77a427e8f3a77026cfb5178/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.336363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef69ab5fd1f4117997b79647a2435e3, user_id=7b1dd40fe77a427e8f3a77026cfb5178, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.339507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.344718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3e1fedc6-242b-42e2-85c8-8ff51b5cef57 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:29.345993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3e1fedc6-242b-42e2-85c8-8ff51b5cef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:29.360521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 986/1944] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:29 2022] PUT /identity/v3/projects/9ef69ab5fd1f4117997b79647a2435e3/users/7b1dd40fe77a427e8f3a77026cfb5178/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:29.372540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.374634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:29.450145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 959/1945] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:29.451432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84376-6c36-4f6d-8ea6-ec7dfb100c9e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.451971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.452401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.452858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.456329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.457713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.458004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.458368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.504115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] MFA Rules not processed for user `7b1dd40fe77a427e8f3a77026cfb5178`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:29.505647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:29.540764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:29.582557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.584077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.588866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:29.595928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 987/1946] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:29.597104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.599196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:29.616761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 960/1947] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:29.624248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.687587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee74c20-f5b5-487d-ad08-58ab5260e877 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.712004 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.712786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.713139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.713489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.724958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.726674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.743601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 988/1948] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:29.757828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3702-4dc1-479f-87a0-7807d8f1d1b5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.762548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.778498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.779198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.779876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.779876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.785461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.789851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.790131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3de8d-c0cf-4db0-89ba-8367192818c4 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.803191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.804136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.804469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.806301 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] PATH_INFO: `/v3/users/5e7e16e80a594d7d9c942d372b5f3881` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.810479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7e16e80a594d7d9c942d372b5f3881)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.815203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.851417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 961/1949] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:29.854252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:29.904104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7e16e80a594d7d9c942d372b5f3881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:29.905688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7e16e80a594d7d9c942d372b5f3881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:29.906455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7e16e80a594d7d9c942d372b5f3881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:29.922972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7e16e80a594d7d9c942d372b5f3881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:29.938771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6627c-67fd-4ea8-b435-50ceb9d49f7d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:29.946068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e142fb21-0c7c-4f5d-94f4-ab6dbbef7345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7e16e80a594d7d9c942d372b5f3881'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:29.948025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:29.949732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.951058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.951476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:29.952978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:29.956426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:29.977297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 989/1950] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:29 2022] DELETE /identity/v3/users/5e7e16e80a594d7d9c942d372b5f3881 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:29.980197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:29.980706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:29.980952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.001155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 962/1951] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:30.003016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:30.004607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.005200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.007514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.023390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6e6a-359a-437c-8155-227b734ff569 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.063352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:30.075545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:30.103714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 990/1952] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:30.108658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.110141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.110508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.110849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.111596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.111734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.113258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.113461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.125452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 963/1953] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:30.129687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.140230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950eee-7e1a-4a09-b2c0-de8ed44fed3c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.145128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.146285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.146562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.147363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] PATH_INFO: `/v3/projects/ae504c6dc0644ceea13ab00e45866566/users/5d22c39a20b24a4aaa3395f396d1a52f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.170327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae504c6dc0644ceea13ab00e45866566, user_id=5d22c39a20b24a4aaa3395f396d1a52f, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.173658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.176247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22c78-fdc7-4615-8426-12018dd03cf2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.181658 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.182687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.182962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.183377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.195792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.197578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.198634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 964/1954] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:30 2022] PUT /identity/v3/projects/ae504c6dc0644ceea13ab00e45866566/users/5d22c39a20b24a4aaa3395f396d1a52f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:30.206547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.211121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 991/1955] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:30.300891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ab77f-876f-4af8-a689-bcea23ebbf74 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.309160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.310278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.311571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.311571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.313789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.316049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a23b5-6501-446c-8c84-e460e4595384 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.339945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 965/1956] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:30.344891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.366857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb8c34-0879-41a9-94e1-14e3ef909b81 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.377691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.379656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.379957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.380241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] PATH_INFO: `/v3/projects/ae504c6dc0644ceea13ab00e45866566/users/5d22c39a20b24a4aaa3395f396d1a52f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.385487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae504c6dc0644ceea13ab00e45866566, user_id=5d22c39a20b24a4aaa3395f396d1a52f, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.391781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.422779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 992/1957] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:30 2022] PUT /identity/v3/projects/ae504c6dc0644ceea13ab00e45866566/users/5d22c39a20b24a4aaa3395f396d1a52f/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:30.433757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.434049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.434326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.461899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] MFA Rules not processed for user `5d22c39a20b24a4aaa3395f396d1a52f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:30.463643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.536062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 966/1958] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:30.548137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.549925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.611587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3138-a441-4253-a973-36347ddf2752 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.615321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.616071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.616356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.616820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.628780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.631527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.642568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 993/1959] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:30.743495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.754770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf28bd0-a478-4a56-8b66-835be44766e3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.758520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.760170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.769986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.770248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.770522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.770848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.773732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:30.816419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:30.841250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f65e-1563-4fe0-a5b6-dc09537e000e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:30.846432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:30.848184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:30.848184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:30.848376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] PATH_INFO: `/v3/projects/687ef80b34fd42de8cd021b0256ebe0c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:30.849567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.849822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687ef80b34fd42de8cd021b0256ebe0c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:30.851091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.851918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:30.862045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 967/1960] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:30.905053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:30.922466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687ef80b34fd42de8cd021b0256ebe0c', 'request_id': 'req-26c4eb3d-2bf9-4517-91c3-678acf89b217'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:30.929404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687ef80b34fd42de8cd021b0256ebe0c', 'request_id': 'req-26c4eb3d-2bf9-4517-91c3-678acf89b217'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:30.944364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687ef80b34fd42de8cd021b0256ebe0c', 'request_id': 'req-26c4eb3d-2bf9-4517-91c3-678acf89b217'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:30.960250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] The token cache is being invalidate because project 687ef80b34fd42de8cd021b0256ebe0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:30.960825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:30.967197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:30.972552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 994/1961] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:30 2022] DELETE /identity/v3/projects/687ef80b34fd42de8cd021b0256ebe0c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:30.974139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:30.989176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38b5e-fcfa-4408-8449-bcc7ca074c3d service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.120007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.122947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.123924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.124404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] PATH_INFO: `/v3/users/2b61b010209b4680ab19dec88bb9222f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.128353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b61b010209b4680ab19dec88bb9222f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:31.134255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:31.159882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:31.162147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.183884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4eb3d-2bf9-4517-91c3-678acf89b217 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.195107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.196264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.199260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.199661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] PATH_INFO: `/v3/users/790a6a5ecd4348b39d6037020b9270b7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.202836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] RBAC: Authorizing `identity:delete_user(user_id=790a6a5ecd4348b39d6037020b9270b7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:31.208732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:31.256902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b61b010209b4680ab19dec88bb9222f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.257670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b61b010209b4680ab19dec88bb9222f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.258600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b61b010209b4680ab19dec88bb9222f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.267984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b61b010209b4680ab19dec88bb9222f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.278759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b61b010209b4680ab19dec88bb9222f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.298363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790a6a5ecd4348b39d6037020b9270b7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.300153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790a6a5ecd4348b39d6037020b9270b7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.301639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790a6a5ecd4348b39d6037020b9270b7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.302296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 968/1962] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:30 2022] DELETE /identity/v3/users/2b61b010209b4680ab19dec88bb9222f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:31.303327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:31.307509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.318903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790a6a5ecd4348b39d6037020b9270b7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.334471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-79c4de26-77c1-4070-979f-529ce95b219f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790a6a5ecd4348b39d6037020b9270b7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.380544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 995/1963] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:31 2022] DELETE /identity/v3/users/790a6a5ecd4348b39d6037020b9270b7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:31.381144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:31.383935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.384582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.384977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.417369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195aeb1-6393-4feb-94e9-b8b7126e4ee2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.431350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:31.432956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.507027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.508486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.508860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.509444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] PATH_INFO: `/v3/users/7b1dd40fe77a427e8f3a77026cfb5178` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.510733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1dd40fe77a427e8f3a77026cfb5178)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:31.512890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:31.519748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 996/1964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:31.526344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:31.527804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.575107 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:31.581612 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1dd40fe77a427e8f3a77026cfb5178'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.582422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1dd40fe77a427e8f3a77026cfb5178'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.583206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1dd40fe77a427e8f3a77026cfb5178'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.591227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1dd40fe77a427e8f3a77026cfb5178'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.599670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b193f38e-1d4b-4576-80a7-f6852d2f40e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1dd40fe77a427e8f3a77026cfb5178'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.604490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65227718-76e2-4ff1-8288-676dc1f0bfb4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.608609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.609275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.609563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.609846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.611891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.624628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:31.626037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 969/1965] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:31 2022] DELETE /identity/v3/users/7b1dd40fe77a427e8f3a77026cfb5178 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:31.626150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:31.630238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb453-d415-4925-9752-495ea8910119 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.630546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb453-d415-4925-9752-495ea8910119 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.631179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb453-d415-4925-9752-495ea8910119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.637220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 997/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:31.655970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-425bb453-d415-4925-9752-495ea8910119 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:31.657394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-425bb453-d415-4925-9752-495ea8910119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.665982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:31.668072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.681432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1b129-e1de-407c-834c-573cc6e5c136 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.768926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 970/1967] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:31.789532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.790748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.791026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.791300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] PATH_INFO: `/v3/projects/6460136c0c474d6c8195143efaddea04` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.792538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6460136c0c474d6c8195143efaddea04)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:31.794445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb453-d415-4925-9752-495ea8910119 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:31.794914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:31.795997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-425bb453-d415-4925-9752-495ea8910119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.832931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:31.857614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6460136c0c474d6c8195143efaddea04', 'request_id': 'req-c7058a8c-0db8-4137-b542-b5450a531836'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.864615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6460136c0c474d6c8195143efaddea04', 'request_id': 'req-c7058a8c-0db8-4137-b542-b5450a531836'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.873642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6460136c0c474d6c8195143efaddea04', 'request_id': 'req-c7058a8c-0db8-4137-b542-b5450a531836'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.900239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] The token cache is being invalidate because project 6460136c0c474d6c8195143efaddea04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:31.900463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.901387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7058a8c-0db8-4137-b542-b5450a531836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:31.902943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 998/1968] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:31 2022] DELETE /identity/v3/projects/6460136c0c474d6c8195143efaddea04 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:31.907897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.908692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.908805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.924081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb453-d415-4925-9752-495ea8910119 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:31.929637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:31.931407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:31.995333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:31.996962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:31.997250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:31.997531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:31.999408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.073413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 999/1969] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:32.074507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.075687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.084919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:32.089513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ebab-add4-44a5-ab4b-17ee194b9de2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.097183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.098077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.098362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.098639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] PATH_INFO: `/v3/projects/606e6d07d3084e5fb4f5a2a45f1c0406` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.099994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606e6d07d3084e5fb4f5a2a45f1c0406)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.102508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.113991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.115491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de734538-e927-4d20-8a3b-6fc99bf9afc3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.126022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 971/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:32.127485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.127775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.128054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.149311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:32.150714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.162154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606e6d07d3084e5fb4f5a2a45f1c0406', 'request_id': 'req-fb5b5a0a-b962-4a02-885c-e989e3ca1250'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.172480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606e6d07d3084e5fb4f5a2a45f1c0406', 'request_id': 'req-fb5b5a0a-b962-4a02-885c-e989e3ca1250'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.185059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606e6d07d3084e5fb4f5a2a45f1c0406', 'request_id': 'req-fb5b5a0a-b962-4a02-885c-e989e3ca1250'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.214869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] The token cache is being invalidate because project 606e6d07d3084e5fb4f5a2a45f1c0406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:32.215394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.215891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb5b5a0a-b962-4a02-885c-e989e3ca1250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.217703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1000/1971] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:32 2022] DELETE /identity/v3/projects/606e6d07d3084e5fb4f5a2a45f1c0406 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:32.222671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-44f9-41af-9253-4680ba0aff03 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.223212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-44f9-41af-9253-4680ba0aff03 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.223709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8a44-44f9-41af-9253-4680ba0aff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.226177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 972/1972] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:32.230459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.239407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ced30-e8a1-4321-b855-e1c66ff8b61b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.244043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-359b8a44-44f9-41af-9253-4680ba0aff03 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:32.244623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.245297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-359b8a44-44f9-41af-9253-4680ba0aff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.245436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.246040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.246040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.246850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:32.247279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.248947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.263856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1001/1973] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:32.266086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.266086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.266370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.270436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 973/1974] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:13:32.271581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.283629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fa92-5a20-4b15-aecb-baa2e677536f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.285622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:32.286838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.289778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.290730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.291070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.291483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.292528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.298758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.299126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1002/1975] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:32.299922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.305042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:32.310474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761d34e-771d-407b-bb68-662fc7e276c4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.317763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.318458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.318897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.319243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.320623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:32.320991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.323749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.337711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1003/1976] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:32.341956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.352987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 974/1977] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:32.356147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef259-cccb-4d30-9606-7601fab7ace1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.356569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.441558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3027-96bf-4371-9013-2aab04422860 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.445037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.446493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.446855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.447261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.448005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.449344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.450025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.450425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.450825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.451166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.451864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.453993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.504199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 975/1978] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:32.504199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.522583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.529782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1004/1979] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:32.530754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.548222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80118e5-c32f-4f04-adbd-0cb528a260e5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.600160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:32.631247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02aa61-fb7a-4841-8439-19e1f90b14a8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.639911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.640636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.640920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.641197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.641935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.644377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.649824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.651243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.652037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.652388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] PATH_INFO: `/v3/projects/9ef69ab5fd1f4117997b79647a2435e3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.653855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef69ab5fd1f4117997b79647a2435e3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.655999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.659655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1005/1980] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:32.660501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.676734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269efd-56a7-45c7-b24b-9fe40378ddbe admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.683222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.683911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.684191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.684494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.685240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.687523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.713116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1006/1981] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:32 2022] POST /identity/v3/users => generated 285 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:32.714269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.724141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef69ab5fd1f4117997b79647a2435e3', 'request_id': 'req-10978a65-d04f-4489-85be-46b05c22053d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.732058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2df882-54ac-4014-b7f9-c677fe4ecd2a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.733559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef69ab5fd1f4117997b79647a2435e3', 'request_id': 'req-10978a65-d04f-4489-85be-46b05c22053d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.741654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef69ab5fd1f4117997b79647a2435e3', 'request_id': 'req-10978a65-d04f-4489-85be-46b05c22053d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.763556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] The token cache is being invalidate because project 9ef69ab5fd1f4117997b79647a2435e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:32.763884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.764588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:32.766506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 976/1982] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:32 2022] DELETE /identity/v3/projects/9ef69ab5fd1f4117997b79647a2435e3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:32.767656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.779171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.792606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:32.858291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.858960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.859238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.859684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.860440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.862094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.890707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978a65-d04f-4489-85be-46b05c22053d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.896073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.897630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.898834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.899270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.900303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.902591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.913708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1007/1983] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:32.914817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.920644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.922607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 977/1984] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:32.925338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:32.929771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:32.942962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc78fb8-4009-4aa3-a2d8-5ff0e3194c22 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.948530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.949821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.950277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.950701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] PATH_INFO: `/v3/users/5d22c39a20b24a4aaa3395f396d1a52f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.952139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d22c39a20b24a4aaa3395f396d1a52f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.954179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15883-45fe-4196-824e-ddfc3490a56d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:32.960971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:32.962043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:32.962426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:32.963140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] PATH_INFO: `/v3/projects/15fdb4d8021a4834a039245d9ace0a52/users/d94c61dbf52b4e8aac095fa38513c6dc/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:32.971246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:32.985368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fdb4d8021a4834a039245d9ace0a52, user_id=d94c61dbf52b4e8aac095fa38513c6dc, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:32.988896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.011683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 978/1985] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:32 2022] PUT /identity/v3/projects/15fdb4d8021a4834a039245d9ace0a52/users/d94c61dbf52b4e8aac095fa38513c6dc/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:33.012767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.062001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d22c39a20b24a4aaa3395f396d1a52f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:33.063221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d22c39a20b24a4aaa3395f396d1a52f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:33.064833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d22c39a20b24a4aaa3395f396d1a52f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:33.081431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d22c39a20b24a4aaa3395f396d1a52f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:33.102457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3d8fb-5d29-41d1-b85f-515e945e439a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.102882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dedb7cee-22d7-4638-b122-4672f607a3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d22c39a20b24a4aaa3395f396d1a52f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:33.112214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.114122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.114519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.114926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.116176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.118443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.132052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1008/1986] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:32 2022] DELETE /identity/v3/users/5d22c39a20b24a4aaa3395f396d1a52f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:33.136322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.136643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.136928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.138431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 979/1987] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:33.139421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.144326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.163303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4ae9-82d2-4bd5-a61c-44ac6f6d9615 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.179289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] MFA Rules not processed for user `d94c61dbf52b4e8aac095fa38513c6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:33.180563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.204192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:33.245424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.246619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.247046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.247510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] PATH_INFO: `/v3/projects/934b0ad5a08f40f2a5cd3f837d218a3a/users/a3c4f45d48f04af3a8d1f322e2d4b464/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.254561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1009/1988] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:33.259364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.260941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.273561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=934b0ad5a08f40f2a5cd3f837d218a3a, user_id=a3c4f45d48f04af3a8d1f322e2d4b464, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.277409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda440af-361e-4bc9-88d7-c865c466bb5b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.278964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c3b9-238d-44aa-8001-24e02c97fda3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.284380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.285524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.285709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.285961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.286770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.289028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.290948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:33.300179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 980/1989] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:33 2022] PUT /identity/v3/projects/934b0ad5a08f40f2a5cd3f837d218a3a/users/a3c4f45d48f04af3a8d1f322e2d4b464/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:33.314322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.315211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.316007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.336712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1010/1990] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:33.338543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.355259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] MFA Rules not processed for user `a3c4f45d48f04af3a8d1f322e2d4b464`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:33.356733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.463661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8038d0e-3f39-4255-a04b-be0a3a13d6d9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.491569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.492288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.492639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.492866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.493573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.497659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 981/1991] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:33.497823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.513737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.515243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.537920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1011/1992] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:33.542081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.570593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea632-84e0-4b1d-8573-87749669f839 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.581937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.582723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.583040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.583321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.584067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.585909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.598445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1012/1993] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:33.602288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.621665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4332-ddad-4786-b750-08d6d0be10e2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.630234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.630997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.631331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.631697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.632479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.637867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.640322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf639-9b02-4ff9-8d4b-0cfdc961c8fe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.645241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.646122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.646482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.647039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.652278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1013/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:33.656883 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:33.662454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.664137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4106c6-aa7b-4360-9a2a-e015d7d2caac service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.672672 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159c83-b35e-4395-9a4c-a9df960438ce admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:33.678091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:33.678881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 982/1995] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:33.686007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.689624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.689863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] PATH_INFO: `/v3/projects/26309833d974470189b4ed0aa91996cb/users/f870a0ccc32649f0bfeb861ef5ea01d4/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.715679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26309833d974470189b4ed0aa91996cb, user_id=f870a0ccc32649f0bfeb861ef5ea01d4, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:33.719688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:33.756887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1014/1996] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:33 2022] PUT /identity/v3/projects/26309833d974470189b4ed0aa91996cb/users/f870a0ccc32649f0bfeb861ef5ea01d4/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:33.757774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:33.758073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:33.758361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:33.821131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] MFA Rules not processed for user `f870a0ccc32649f0bfeb861ef5ea01d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:33.823073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:33.964881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 983/1997] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:33.970622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.054772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:34.096631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86006-3eac-4752-a7b3-d7f67a19b44f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.115086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.115980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.116271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.116580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.117298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.119243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.182112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1015/1998] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:34.186373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.202688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ad84-0acb-4be6-a747-824b8b69fed1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.239717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:34.251940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.254130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.339175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.340825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.341182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.341473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.342165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.344715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.394247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 984/1999] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:34.398659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.407374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a89959-e256-4f95-8d36-293bc0a22846 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.413576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654e8e-2380-44a0-a1a5-894bf58b4d0e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.414383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.415404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.415718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.416049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] PATH_INFO: `/v3/projects/ae504c6dc0644ceea13ab00e45866566` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.417424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae504c6dc0644ceea13ab00e45866566)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.419674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.420407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.421289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.421752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.422094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.423131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.425309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.439613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 985/2000] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:34.444715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.470232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204ca5-6e6d-4bd4-b4ff-4a3a65e9bfdb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.504092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae504c6dc0644ceea13ab00e45866566', 'request_id': 'req-76025ba8-db65-48d8-8f5e-188f71828031'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:34.511587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae504c6dc0644ceea13ab00e45866566', 'request_id': 'req-76025ba8-db65-48d8-8f5e-188f71828031'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:34.523889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae504c6dc0644ceea13ab00e45866566', 'request_id': 'req-76025ba8-db65-48d8-8f5e-188f71828031'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:34.535294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] The token cache is being invalidate because project ae504c6dc0644ceea13ab00e45866566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:34.535686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:34.536198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-76025ba8-db65-48d8-8f5e-188f71828031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:34.543147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1016/2001] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:34 2022] DELETE /identity/v3/projects/ae504c6dc0644ceea13ab00e45866566 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:34.546726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc696d-d4ce-4f1f-9dfb-8f5bfc9dd33a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.548671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc696d-d4ce-4f1f-9dfb-8f5bfc9dd33a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.549062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc696d-d4ce-4f1f-9dfb-8f5bfc9dd33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.576582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3fcc696d-d4ce-4f1f-9dfb-8f5bfc9dd33a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:34.578833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3fcc696d-d4ce-4f1f-9dfb-8f5bfc9dd33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.589309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.591547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.591999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.592487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] PATH_INFO: `/v3/projects/a85ed0b03b09473283473be69b3c5c7a/users/8a6b8798f1eb4678bbb2c115fcaf0b8e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.609734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85ed0b03b09473283473be69b3c5c7a, user_id=8a6b8798f1eb4678bbb2c115fcaf0b8e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.613087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.627354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 986/2002] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:34 2022] PUT /identity/v3/projects/a85ed0b03b09473283473be69b3c5c7a/users/8a6b8798f1eb4678bbb2c115fcaf0b8e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:34.631491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.633263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.636195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:34.647622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1017/2003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:34.656232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.656544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.656822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.674599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:34.675912 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.706219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82f97a-eaad-41bc-9e53-1f9e4cf1d5f4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.710975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.711652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.711947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.712225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.713002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.714655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.724574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 987/2004] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:34.728809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.735535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1018/2005] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:34.738143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d917-ef6e-45b4-8ef3-6c0da1895ef4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.739650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.742844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.743720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.744008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.744281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] PATH_INFO: `/v3/projects/a85ed0b03b09473283473be69b3c5c7a/users/8a6b8798f1eb4678bbb2c115fcaf0b8e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.746289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85ed0b03b09473283473be69b3c5c7a, user_id=8a6b8798f1eb4678bbb2c115fcaf0b8e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.748498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b0fe-657a-4eac-85c7-55cc6d0d621e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.748966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f5551-a6a9-48c2-93f6-ade57b2018ab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.753266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.753917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.754198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.754537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.755203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:34.755512 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.757232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.760323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 988/2006] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:34 2022] PUT /identity/v3/projects/a85ed0b03b09473283473be69b3c5c7a/users/8a6b8798f1eb4678bbb2c115fcaf0b8e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:34.770014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1019/2007] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:34.773016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.773329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.773587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.774397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.780431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:34.785016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d8cd7-0c3b-4110-9b37-69900aee64c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.801545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] MFA Rules not processed for user `8a6b8798f1eb4678bbb2c115fcaf0b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:34.802769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.845775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.846548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.846908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.847255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.848013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.850138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:34.884053 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1020/2008] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:34.884784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 989/2009] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:34.893508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.897987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:34.900257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:34.908177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004194-99da-4be1-9d26-eb0f3538d19c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.988485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cd6e-b05f-4015-a519-322c2eda62f0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:34.992892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.993715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.994167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.994578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.995244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:34.995938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:34.996216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:34.996527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:34.997228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:34.999858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.028478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 990/2010] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:34 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:35.028671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:35.031420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:35.049040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7214d8-f433-4deb-991d-ce1ca20251d9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:35.054753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:35.055442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.055727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.056004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.057003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.058668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.072654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 991/2011] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:35.074371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.076373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.076512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:35.088223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1021/2012] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:35.089604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009b12f-55d3-4e97-9693-e33778b6898b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:35.095537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:35.096346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.096781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.097278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.098260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.100007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.114365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 992/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:35.118663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:35.131848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac747-120f-4161-a9a4-857d5d51f48d service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:35.137097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:35.138243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.138561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.138841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] PATH_INFO: `/v3/projects/9a5c7e5178054b4a8d36a1d95b415399/users/ef0e2dce9c7b4be092e57989b880820d/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.145149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:35.147181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:35.159906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5c7e5178054b4a8d36a1d95b415399, user_id=ef0e2dce9c7b4be092e57989b880820d, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.163936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fa843-2dad-48ab-a901-1e2f6f56d019 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.167311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876425f5-4754-47b9-aab8-bb57c972c426 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:35.171878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:35.172763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.173151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.173525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.175570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:35.180893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1022/2014] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:35 2022] PUT /identity/v3/projects/9a5c7e5178054b4a8d36a1d95b415399/users/ef0e2dce9c7b4be092e57989b880820d/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:35.192431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.192431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.192736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.221678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] MFA Rules not processed for user `ef0e2dce9c7b4be092e57989b880820d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:35.222847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:35.255779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:35.259565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.262271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.273309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 993/2015] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:35.311946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1023/2016] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:35.331607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:35.333432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:35.404104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1948-53b7-4ec1-99d4-d11224b60ca4 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:35.459219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:35.459964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:35.460252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:35.460635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:35.471766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:35.473349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78ccf7-129d-4d9c-836b-afdbc2194f63 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:35.485085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 994/2017] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:37.792171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:37.793761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:37.887361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83782a-382b-4e1e-884e-82003f55b28a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:37.896475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:37.897619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:37.898002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:37.898521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] PATH_INFO: `/v3/users/c6bfcd633b5a43cf99ac22944121885f` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:37.899748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bfcd633b5a43cf99ac22944121885f)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:37.901880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:37.962540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:37.982695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bfcd633b5a43cf99ac22944121885f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:37.983354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bfcd633b5a43cf99ac22944121885f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:37.983964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bfcd633b5a43cf99ac22944121885f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:37.990876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bfcd633b5a43cf99ac22944121885f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.002684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bfcd633b5a43cf99ac22944121885f'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.020322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1024/2018] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:37 2022] DELETE /identity/v3/users/c6bfcd633b5a43cf99ac22944121885f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:38.024727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.025613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.025751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.055524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:38.056806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.131986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 995/2019] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:38.142291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:38.143713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.224066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82050464-bf08-41cf-b4a0-bda056b43043 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:38.227971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:38.228662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.228938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.229208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.240298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:38.241827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224164d-4f1f-4551-9497-290a3044f6b6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:38.275465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1025/2020] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:38.579440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:38.581422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.595000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54bd26-3e1f-4d13-9498-5bffff962c9c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:38.600309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:38.601411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.601758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.602087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] PATH_INFO: `/v3/users/d94c61dbf52b4e8aac095fa38513c6dc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.603289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94c61dbf52b4e8aac095fa38513c6dc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:38.605454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:38.659049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94c61dbf52b4e8aac095fa38513c6dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.659856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94c61dbf52b4e8aac095fa38513c6dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.660671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94c61dbf52b4e8aac095fa38513c6dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.662993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:38.670201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94c61dbf52b4e8aac095fa38513c6dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.684375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94c61dbf52b4e8aac095fa38513c6dc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.705185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 996/2021] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:38 2022] DELETE /identity/v3/users/d94c61dbf52b4e8aac095fa38513c6dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:38.709774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.710238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.710517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.727280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:38.728524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.789056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1026/2022] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:38.799609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:38.801378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.823726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:38.825261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:38.843763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634acd0d-ecf2-4f3c-8e59-d6e9b88ac7e8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:38.874058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:38.875750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.876104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.876476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] PATH_INFO: `/v3/projects/3513bcc34dfa4183b73e5626c79e7e57` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.877715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3513bcc34dfa4183b73e5626c79e7e57)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:38.879687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:38.886082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c735a-044a-4826-9f65-7ccec7bad46c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:38.889844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:38.890528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:38.890843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:38.891175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:38.901223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:38.902692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:38.916729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 997/2023] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:38.933189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:38.937741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3513bcc34dfa4183b73e5626c79e7e57', 'request_id': 'req-62a8b083-6509-42b2-8dc1-61aff7cdfb44'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.947907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3513bcc34dfa4183b73e5626c79e7e57', 'request_id': 'req-62a8b083-6509-42b2-8dc1-61aff7cdfb44'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.954187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3513bcc34dfa4183b73e5626c79e7e57', 'request_id': 'req-62a8b083-6509-42b2-8dc1-61aff7cdfb44'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.981702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] The token cache is being invalidate because project 3513bcc34dfa4183b73e5626c79e7e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:38.982172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.983084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:38.985151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1027/2024] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:38 2022] DELETE /identity/v3/projects/3513bcc34dfa4183b73e5626c79e7e57 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:38.989267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:39.000547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0e91-57cc-4841-be3c-8c4984527702 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:39.075608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:39.077246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:39.077686 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:39.078349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] PATH_INFO: `/v3/users/c85fd75c6f2040b185ac3a5bae9a2011` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:39.079697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85fd75c6f2040b185ac3a5bae9a2011)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:39.082262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:39.140941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85fd75c6f2040b185ac3a5bae9a2011'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.141769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85fd75c6f2040b185ac3a5bae9a2011'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.142579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85fd75c6f2040b185ac3a5bae9a2011'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.152320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85fd75c6f2040b185ac3a5bae9a2011'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.161898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85fd75c6f2040b185ac3a5bae9a2011'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.169665 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:39.184900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 998/2025] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:38 2022] DELETE /identity/v3/users/c85fd75c6f2040b185ac3a5bae9a2011 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:39.471049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:39.472821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:39.493428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b083-6509-42b2-8dc1-61aff7cdfb44 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:39.604675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:39.605562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:39.605842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:39.606118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] PATH_INFO: `/v3/projects/15fdb4d8021a4834a039245d9ace0a52` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:39.607586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fdb4d8021a4834a039245d9ace0a52)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:39.609579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:39.676440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:39.677955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:39.704405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fdb4d8021a4834a039245d9ace0a52', 'request_id': 'req-f5742139-1652-401d-baa3-af3bce93ae1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.719080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8306b6d-fcf2-4ee3-9749-c4e842af3103 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:39.721325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fdb4d8021a4834a039245d9ace0a52', 'request_id': 'req-f5742139-1652-401d-baa3-af3bce93ae1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.736293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fdb4d8021a4834a039245d9ace0a52', 'request_id': 'req-f5742139-1652-401d-baa3-af3bce93ae1a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.764948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] The token cache is being invalidate because project 15fdb4d8021a4834a039245d9ace0a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:39.765337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.768894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.773121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1028/2026] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:39 2022] DELETE /identity/v3/projects/15fdb4d8021a4834a039245d9ace0a52 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:39.780094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:39.784030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:39.810593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:39.811694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:39.812491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:39.812491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] PATH_INFO: `/v3/projects/282b04f941324855ac90b87d34bab7df` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:39.814121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282b04f941324855ac90b87d34bab7df)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:39.816523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:39.894828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282b04f941324855ac90b87d34bab7df', 'request_id': 'req-97cfa30b-f529-4ba7-8c8c-94e5c9246649'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.895026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742139-1652-401d-baa3-af3bce93ae1a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:39.903072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282b04f941324855ac90b87d34bab7df', 'request_id': 'req-97cfa30b-f529-4ba7-8c8c-94e5c9246649'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.910394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:39.912142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282b04f941324855ac90b87d34bab7df', 'request_id': 'req-97cfa30b-f529-4ba7-8c8c-94e5c9246649'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.929924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] The token cache is being invalidate because project 282b04f941324855ac90b87d34bab7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:39.931855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.932626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-97cfa30b-f529-4ba7-8c8c-94e5c9246649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:39.934954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 999/2027] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:39 2022] DELETE /identity/v3/projects/282b04f941324855ac90b87d34bab7df => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:39.939851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374708-83e9-456a-b509-f40ec412e055 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:39.940147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374708-83e9-456a-b509-f40ec412e055 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:39.940435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374708-83e9-456a-b509-f40ec412e055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:39.967334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b374708-83e9-456a-b509-f40ec412e055 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:39.968629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b374708-83e9-456a-b509-f40ec412e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:40.002062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.002968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.003323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.003691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] PATH_INFO: `/v3/users/f870a0ccc32649f0bfeb861ef5ea01d4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.005005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f870a0ccc32649f0bfeb861ef5ea01d4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.007478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.051083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1000/2028] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:40.053022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.053495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.053672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.062514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f870a0ccc32649f0bfeb861ef5ea01d4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.063258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f870a0ccc32649f0bfeb861ef5ea01d4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.063896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f870a0ccc32649f0bfeb861ef5ea01d4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.071284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f870a0ccc32649f0bfeb861ef5ea01d4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.073650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:40.074851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:40.081458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f870a0ccc32649f0bfeb861ef5ea01d4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.085588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1001/2029] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:40.089723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.099384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c976-6eb7-47a7-9866-6276cff6992e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.100376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1029/2030] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:39 2022] DELETE /identity/v3/users/f870a0ccc32649f0bfeb861ef5ea01d4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:40.109978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:40.178174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.178905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.179221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.179596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.180292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:40.180677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.182330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.198709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1002/2031] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:13:40.201452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.216508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04b9-1f49-472c-926f-f9c11c3e4d86 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.221367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.222039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.222322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.222598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.223310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.225350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.258470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1030/2032] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:40.262479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.274415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe18f55-a720-4b99-806a-6b9c15bc7988 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.362805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.364697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.365322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.365845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.366817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.369094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.398938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1003/2033] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:40.400168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.411011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f1d7-0931-4bbc-a9f6-4c2f4ca38dde admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.429164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.430104 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.430395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.430735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.431601 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.433904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.451540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1031/2034] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:40.456803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.477535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6740ab-424e-495a-b176-45133c9dc5e3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.487290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.488178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.488632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.489016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.490196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.492235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340532d-c0e2-41f0-84e8-79c6a4d0957b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.504022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1004/2035] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:40.508682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.521398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f730a-399c-449c-983b-970aabae1e9e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.529619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.530629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.530978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.531261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] PATH_INFO: `/v3/projects/8e5194697c9d4fc496def880db378f23/users/6debe11d3e04410f9c6eea9f3ed1e7b8/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.547922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5194697c9d4fc496def880db378f23, user_id=6debe11d3e04410f9c6eea9f3ed1e7b8, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.550812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.565914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1032/2036] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:40 2022] PUT /identity/v3/projects/8e5194697c9d4fc496def880db378f23/users/6debe11d3e04410f9c6eea9f3ed1e7b8/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:40.576704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.577083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.577389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.605108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] MFA Rules not processed for user `6debe11d3e04410f9c6eea9f3ed1e7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:40.606237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:40.706185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1005/2037] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:40.711616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.752164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:40.788922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c15fe7-b155-422d-8cd6-7f7ce2c12c84 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.794473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.795467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.795844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.796161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.796931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.797293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.798887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.799647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:40.815721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af0b1-e520-4d3e-96c2-80508b7d2a92 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:40.821967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:40.822849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:40.823139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:40.823518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] PATH_INFO: `/v3/projects/26309833d974470189b4ed0aa91996cb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:40.824976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26309833d974470189b4ed0aa91996cb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:40.827240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:40.833140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1033/2038] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:40.841989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:40.845532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.896730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26309833d974470189b4ed0aa91996cb', 'request_id': 'req-436752a6-a592-4ad8-81ae-569b645f30e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.905125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26309833d974470189b4ed0aa91996cb', 'request_id': 'req-436752a6-a592-4ad8-81ae-569b645f30e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.928057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26309833d974470189b4ed0aa91996cb', 'request_id': 'req-436752a6-a592-4ad8-81ae-569b645f30e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.945606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] The token cache is being invalidate because project 26309833d974470189b4ed0aa91996cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:40.945893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.946547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:40.948125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1006/2039] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:40 2022] DELETE /identity/v3/projects/26309833d974470189b4ed0aa91996cb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:40.952003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:40.953429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:40.957244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7fc3a-9ee5-4b21-bdcb-46caf3b642e5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.025507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.026501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436752a6-a592-4ad8-81ae-569b645f30e1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.026644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.026976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.027290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.028074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.032219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.032438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.033477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.033875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.034242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] PATH_INFO: `/v3/users/8a6b8798f1eb4678bbb2c115fcaf0b8e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.035585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6b8798f1eb4678bbb2c115fcaf0b8e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.037785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.056623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1034/2040] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:40 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:41.060415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:41.062186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:41.075479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc2f2-40cf-4ef9-bc78-0eeb0c0b98f8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.081025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.081735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.082020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.082305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.083048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.084766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.096718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1035/2041] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:41.101556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6b8798f1eb4678bbb2c115fcaf0b8e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:41.102280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6b8798f1eb4678bbb2c115fcaf0b8e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:41.102893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6b8798f1eb4678bbb2c115fcaf0b8e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:41.103765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:41.106229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:41.110597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6b8798f1eb4678bbb2c115fcaf0b8e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:41.119694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb4920-23a2-4a72-b8f3-98b8c3cbc5c4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.119973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6b8798f1eb4678bbb2c115fcaf0b8e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:41.127687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.129617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.130125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.130665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] PATH_INFO: `/v3/projects/5cb45dc14e5645b797554e5806698a0f/users/ee2b13a08513435985b8aa8ed509a3f5/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.140857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1007/2042] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:40 2022] DELETE /identity/v3/users/8a6b8798f1eb4678bbb2c115fcaf0b8e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:41.153230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb45dc14e5645b797554e5806698a0f, user_id=ee2b13a08513435985b8aa8ed509a3f5, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.157345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.188648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1036/2043] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:41 2022] PUT /identity/v3/projects/5cb45dc14e5645b797554e5806698a0f/users/ee2b13a08513435985b8aa8ed509a3f5/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:41.190070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:41.224776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:41.292938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066b48-789d-4df0-bccf-b8da6faa2fe9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.379018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.379839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.380293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.380705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.382193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.383579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1f9b-a067-4696-8648-3e7b3bcaea0a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.395885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1008/2044] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:41.399955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:41.413866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cfe1-2488-4a1e-930b-7d821b70a521 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.420559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.422739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.423504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.424077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] PATH_INFO: `/v3/projects/5cb45dc14e5645b797554e5806698a0f/users/ee2b13a08513435985b8aa8ed509a3f5/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.428647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb45dc14e5645b797554e5806698a0f, user_id=ee2b13a08513435985b8aa8ed509a3f5, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.432001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.456841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1037/2045] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:41 2022] PUT /identity/v3/projects/5cb45dc14e5645b797554e5806698a0f/users/ee2b13a08513435985b8aa8ed509a3f5/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:41.467300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.467642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.467922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.499824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] MFA Rules not processed for user `ee2b13a08513435985b8aa8ed509a3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:41.501113 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:41.587660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1009/2046] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:41.598565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:41.600278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:41.610101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:41.672863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77098-517c-464b-bda6-90512337831c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:41.677064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:41.677810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:41.678375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:41.679264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:41.696767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:41.698493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e8cf-f03b-433b-82fa-648165274dcc service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:41.710334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1038/2047] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:42.181582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:42.184009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:42.271595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:42.325903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a44f9-cbd8-4503-87d6-1621f401740b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:42.334247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:42.335248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.335578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.335866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] PATH_INFO: `/v3/projects/a85ed0b03b09473283473be69b3c5c7a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.337820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85ed0b03b09473283473be69b3c5c7a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:42.339870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:42.408418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85ed0b03b09473283473be69b3c5c7a', 'request_id': 'req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:42.415250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85ed0b03b09473283473be69b3c5c7a', 'request_id': 'req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:42.428551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85ed0b03b09473283473be69b3c5c7a', 'request_id': 'req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:42.442591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] The token cache is being invalidate because project a85ed0b03b09473283473be69b3c5c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:42.442915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:42.443610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9fbb5c3f-fb76-4761-8598-084ecf5e11f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:42.445253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1010/2048] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:42 2022] DELETE /identity/v3/projects/a85ed0b03b09473283473be69b3c5c7a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:42.456891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.457391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.457478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.501285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:42.502812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:42.601122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1039/2049] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:42.610162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.610459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.610749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.631189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:42.632519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:42.640908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1011/2050] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:42.645923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:42.656699 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910810-faae-4854-9b18-d159d8d112fe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:42.663837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:42.664419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.664810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.665148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.666524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:42.666904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:42.668693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:42.683411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1040/2051] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:42.689694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:42.700610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139282c-5ec1-413a-9755-1155ea7ea2f3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:42.705946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:42.706626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.706903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.707182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.707886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:42.709979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:42.758195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1012/2052] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:42 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:42.761872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:42.779038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329fa0-156e-4087-a3e7-25bc08bac2fa admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:42.889811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:42.890857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.891323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.891796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.893550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:42.901113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:42.935275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1041/2053] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:42 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:42.939944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:42.962848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eda7b-96e1-4e65-b65c-5002f5f7e532 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:42.970883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:42.971273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:42.971682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:42.972029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:42.972975 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:42.974680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:42.987337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1013/2054] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:42.992013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:43.002865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbf9f-b5bf-46a9-9df6-9d63e289bc08 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:43.008379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:43.009127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.009401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.009675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.010420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:43.012060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fc81c-6180-45a9-8752-2320ed37c576 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:43.041343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1042/2055] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:43.045738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:43.062243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56045-45fe-40bb-aab7-30c755f5eae8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:43.075038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:43.076228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.076945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.077451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] PATH_INFO: `/v3/projects/a568e70796df4186832b1263fdecaac5/users/0af50128e0834e42a4eaf4d460dc48fe/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.103705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a568e70796df4186832b1263fdecaac5, user_id=0af50128e0834e42a4eaf4d460dc48fe, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:43.106997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:43.143069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1014/2056] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:43 2022] PUT /identity/v3/projects/a568e70796df4186832b1263fdecaac5/users/0af50128e0834e42a4eaf4d460dc48fe/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:43.154357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.154725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.155076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.207876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] MFA Rules not processed for user `0af50128e0834e42a4eaf4d460dc48fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:43.216354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:43.233027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:43.348747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1043/2057] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:43.368695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:43.371123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:43.501305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda6f5-7966-40c1-9495-cffd6e108161 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:43.510353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:43.511223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.511601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.511997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.539374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:43.541117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:43.560641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1015/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:43.586816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:43.741136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8d84f-8b81-4d75-90a3-213f4199cb8c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:43.747211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:43.748362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.750524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.751005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] PATH_INFO: `/v3/users/0af50128e0834e42a4eaf4d460dc48fe` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.752418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af50128e0834e42a4eaf4d460dc48fe)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:43.754579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:43.774263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:43.775732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:43.791478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d0e-24d8-4db0-ac19-c3d27764cb83 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:43.803154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:43.805122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.805378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.805715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] PATH_INFO: `/v3/users/6debe11d3e04410f9c6eea9f3ed1e7b8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.807593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6debe11d3e04410f9c6eea9f3ed1e7b8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:43.813595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:43.831372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:43.833827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af50128e0834e42a4eaf4d460dc48fe'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.835325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af50128e0834e42a4eaf4d460dc48fe'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.836293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af50128e0834e42a4eaf4d460dc48fe'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.850117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af50128e0834e42a4eaf4d460dc48fe'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.863439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a862b8b1-dde5-4b25-9a25-8f41bd1f0dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af50128e0834e42a4eaf4d460dc48fe'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.895727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6debe11d3e04410f9c6eea9f3ed1e7b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.896849 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6debe11d3e04410f9c6eea9f3ed1e7b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.898587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6debe11d3e04410f9c6eea9f3ed1e7b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.904526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1044/2059] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:43 2022] DELETE /identity/v3/users/0af50128e0834e42a4eaf4d460dc48fe => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:43.911326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.911620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.911920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.917744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6debe11d3e04410f9c6eea9f3ed1e7b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.932078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a493490c-84f5-45f2-a2a2-7f74decd7ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6debe11d3e04410f9c6eea9f3ed1e7b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:43.937027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:43.938979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:43.956007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1016/2060] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:43 2022] DELETE /identity/v3/users/6debe11d3e04410f9c6eea9f3ed1e7b8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:13:43.960695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:43.960991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:43.961278 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:43.966774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:43.986753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:43.995764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:44.042833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1045/2061] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:44.069408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:44.071708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:44.113450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1017/2062] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:44.132072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:44.133671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:44.187748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f54fd9-5f43-45cd-944a-3a75a71f671e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:44.230042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be253e-014a-4213-ab55-0290acc5aa8e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:44.245753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:44.246578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:44.246877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:44.247174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:44.259646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:44.261407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:44.276585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1018/2063] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:44.279303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:44.279992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:44.280267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:44.280579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:44.293129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:44.294509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:44.309786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1046/2064] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:44.964248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:44.967158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:44.986864 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c522-9653-4d23-8066-6ff84b063891 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:44.992952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:44.993855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:44.994688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:44.994688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] PATH_INFO: `/v3/projects/8e5194697c9d4fc496def880db378f23` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:44.995626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5194697c9d4fc496def880db378f23)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:44.997662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.039733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:45.070843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5194697c9d4fc496def880db378f23', 'request_id': 'req-815dcf45-1a57-480c-b838-9afac37762a6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.078661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5194697c9d4fc496def880db378f23', 'request_id': 'req-815dcf45-1a57-480c-b838-9afac37762a6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.108542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5194697c9d4fc496def880db378f23', 'request_id': 'req-815dcf45-1a57-480c-b838-9afac37762a6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.124007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] The token cache is being invalidate because project 8e5194697c9d4fc496def880db378f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:45.124897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.125602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.127876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1019/2065] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:44 2022] DELETE /identity/v3/projects/8e5194697c9d4fc496def880db378f23 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:45.133960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.144191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f119a-0fd5-4045-a182-b1d0d0b4aa0f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.199232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.201531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:45.225752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.226567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.228417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.228981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] PATH_INFO: `/v3/users/ee2b13a08513435985b8aa8ed509a3f5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.230387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2b13a08513435985b8aa8ed509a3f5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.232738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.275659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:45.277466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcf45-1a57-480c-b838-9afac37762a6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.282944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.283820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.284102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.284386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] PATH_INFO: `/v3/projects/a568e70796df4186832b1263fdecaac5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.285685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a568e70796df4186832b1263fdecaac5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.287805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.303285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2b13a08513435985b8aa8ed509a3f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.304305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2b13a08513435985b8aa8ed509a3f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.305161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2b13a08513435985b8aa8ed509a3f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.312699 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2b13a08513435985b8aa8ed509a3f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.322003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f7be5f64-b229-4362-b73a-11e65924bb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2b13a08513435985b8aa8ed509a3f5'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.343361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1047/2066] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:45 2022] DELETE /identity/v3/users/ee2b13a08513435985b8aa8ed509a3f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:45.355791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a568e70796df4186832b1263fdecaac5', 'request_id': 'req-08f90656-df99-4389-83fd-fa4c0d450abb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.367283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a568e70796df4186832b1263fdecaac5', 'request_id': 'req-08f90656-df99-4389-83fd-fa4c0d450abb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.383881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a568e70796df4186832b1263fdecaac5', 'request_id': 'req-08f90656-df99-4389-83fd-fa4c0d450abb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.398354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] The token cache is being invalidate because project a568e70796df4186832b1263fdecaac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:45.398696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.399418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-08f90656-df99-4389-83fd-fa4c0d450abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.404507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1020/2067] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:45 2022] DELETE /identity/v3/projects/a568e70796df4186832b1263fdecaac5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:45.407209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.407663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.408013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.427608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:45.429041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:45.535316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1048/2068] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:45.542901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.543265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.543512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.563356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:45.574913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:45.586368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1021/2069] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:45.590029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.600691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2d3cb-2454-4cec-8759-6addf6e53d76 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.605664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.606424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.606780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.607133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.607941 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:45.608318 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.610409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.631227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1049/2070] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:45.636430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.647501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2cfc-cabd-4a43-b0a9-7d5f095a4071 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.653479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.654224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.654507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.654780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.656173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.658147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.692596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1022/2071] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:45 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:45.696720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.708081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b821-f39d-466c-bece-ee2230994b4c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.717505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.720102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:45.750967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:45.775229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.775929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.776227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.776533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.777232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.779202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.805679 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1050/2072] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:45 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:45.810920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.827195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b33cb1-3881-4576-bbae-b1a438861274 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.839244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.840084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.840520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.840906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.841758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.843637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.854990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1051/2073] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:45.860313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.863079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d9a1-63d5-4b54-a4f1-df0fc798b5e5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.867966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.868914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.869199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.869479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] PATH_INFO: `/v3/projects/5cb45dc14e5645b797554e5806698a0f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.870719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb45dc14e5645b797554e5806698a0f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.872701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.873907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680c10-1c86-4b2b-8432-a4987b09b2d7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.878904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.879673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.880328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.880328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.881240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.882995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.885552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:45.899119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1052/2074] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:45.900408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:45.912422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a5db-d9bb-4cfb-8780-3248a2cb90ce admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:45.917895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:45.918979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.919364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.920490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] PATH_INFO: `/v3/projects/26a35f0aa329425fadddf6d36b51f1f8/users/d48c7485e7c0402ba8409ca74685d056/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:45.935215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a35f0aa329425fadddf6d36b51f1f8, user_id=d48c7485e7c0402ba8409ca74685d056, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:45.938724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e265140-a682-4419-b78e-061c0a01ce65 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:45.941496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb45dc14e5645b797554e5806698a0f', 'request_id': 'req-0aca22c4-0f61-4e1b-a490-4d5a67327015'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.948877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb45dc14e5645b797554e5806698a0f', 'request_id': 'req-0aca22c4-0f61-4e1b-a490-4d5a67327015'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.955782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1053/2075] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:45 2022] PUT /identity/v3/projects/26a35f0aa329425fadddf6d36b51f1f8/users/d48c7485e7c0402ba8409ca74685d056/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:45.961166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb45dc14e5645b797554e5806698a0f', 'request_id': 'req-0aca22c4-0f61-4e1b-a490-4d5a67327015'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.979643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] The token cache is being invalidate because project 5cb45dc14e5645b797554e5806698a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:45.980345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.980688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0aca22c4-0f61-4e1b-a490-4d5a67327015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:45.986160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1023/2076] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:45 2022] DELETE /identity/v3/projects/5cb45dc14e5645b797554e5806698a0f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:45.992875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92087e6-c219-489b-801f-d6c7e9f00077 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:45.993811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92087e6-c219-489b-801f-d6c7e9f00077 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:45.994242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92087e6-c219-489b-801f-d6c7e9f00077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.022414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c92087e6-c219-489b-801f-d6c7e9f00077 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:46.023974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c92087e6-c219-489b-801f-d6c7e9f00077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:46.032471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.033504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.033967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.065756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] MFA Rules not processed for user `d48c7485e7c0402ba8409ca74685d056`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:46.067355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:46.110029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1054/2077] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:46.120480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.120480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.120480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.155959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:46.158127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:46.180606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1024/2078] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:46.180806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1055/2079] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:46.184158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.196275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.196956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec8741-e687-4d9a-98c9-c1e4d66ce062 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.197833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:46.201948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.202658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.202995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.203382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.204165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:46.204535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.206229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.223005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1025/2080] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:46.227555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.240427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22a63-1e58-498b-b2d8-5fac6e9ba783 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.246179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.247585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.248275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.249012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.250107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.252745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.269294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adb0b-6999-4ad0-973b-4a30bfb33034 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.274600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.275014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.275386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.275714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.280795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:46.291472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.297961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1026/2081] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:46.303952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.314268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.327327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1056/2082] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:46.464088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f7ec-8db2-410c-b748-466c7ce6749b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.469297 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.470236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.470670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.471252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.472121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.474460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.501482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1027/2083] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:46.507012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.525414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1721-2141-46d0-8392-77d6b854a76f service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.531210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.534178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.534178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.534178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.534178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.536483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.554341 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1057/2084] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:46.557682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.571790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d818-393c-4589-a046-3b5f79c6f22f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.580151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.582025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.582410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.582895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.583825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.587867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ffd4-46f1-4b3f-ba74-97e0d158efb1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.604970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1028/2085] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:46.606091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.620549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e6c99-8787-42bb-8069-2bd6d8e0a933 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.627144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.628310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.628438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.629128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] PATH_INFO: `/v3/projects/12f487e7f03b48378b4d462380fb3db6/users/579a03998371422a91d48995203963ca/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.646788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f487e7f03b48378b4d462380fb3db6, user_id=579a03998371422a91d48995203963ca, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.649808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:46.672742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1058/2086] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:46 2022] PUT /identity/v3/projects/12f487e7f03b48378b4d462380fb3db6/users/579a03998371422a91d48995203963ca/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:46.685790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.685971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.686281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.733695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] MFA Rules not processed for user `579a03998371422a91d48995203963ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:46.736306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:46.874776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1029/2087] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:46.876021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:46.937776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:46.973551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4285e-4815-437f-8135-b8a8238facd7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:46.986928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:46.987646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:46.988305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:46.989661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:46.992788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:46.994826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.050544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1059/2088] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:46 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:47.052789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.065181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854621-c38a-4653-b8ba-7a234739e19f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.131067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.131752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.132033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.132310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.133044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.135007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.150580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:47.160387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1030/2089] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:47 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:47.161328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.171895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b00e1-deb3-4347-8d31-ef834b11069c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.176692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.177355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.177674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.177975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.178693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.180349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.192564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1060/2090] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:13:47.196979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.207400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68022-b7b0-4462-b393-74407331f35b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.213547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.214617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.214868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.215143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] PATH_INFO: `/v3/projects/261a420222b74a90af5fe5e7b10adbf8/users/a9aaf3b10675423da8bbaf7469dc54a3/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.230696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a420222b74a90af5fe5e7b10adbf8, user_id=a9aaf3b10675423da8bbaf7469dc54a3, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.233453 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.247953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1031/2091] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:47 2022] PUT /identity/v3/projects/261a420222b74a90af5fe5e7b10adbf8/users/a9aaf3b10675423da8bbaf7469dc54a3/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:47.252078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.262106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7e25-6d09-47ae-b00f-321f3efa799d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.327396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.328300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.328300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.328584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.329312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.331018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429f85-db5b-4573-8ba1-179eb1813696 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.344584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1061/2092] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:47.348556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.361596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafd657-9f0a-458b-9883-530e8d0e5b36 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.369833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.373095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.373454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.373801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] PATH_INFO: `/v3/projects/261a420222b74a90af5fe5e7b10adbf8/users/a9aaf3b10675423da8bbaf7469dc54a3/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.376182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a420222b74a90af5fe5e7b10adbf8, user_id=a9aaf3b10675423da8bbaf7469dc54a3, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.379017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.390669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1032/2093] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:47 2022] PUT /identity/v3/projects/261a420222b74a90af5fe5e7b10adbf8/users/a9aaf3b10675423da8bbaf7469dc54a3/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:47.401848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.402096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.402368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.432397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] MFA Rules not processed for user `a9aaf3b10675423da8bbaf7469dc54a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:47.433930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:47.518085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1062/2094] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:47.531328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.594935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cffa2-c9e5-4961-acbf-e6f4657a1058 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.598947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.599706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.599990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.600261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.610117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.611615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.634954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1033/2095] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:47.675667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:47.677101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:47.692987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b169292-8d98-4ee0-ae21-801587ed0fe2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:47.697605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:47.699074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:47.699362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:47.699635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:47.732491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:47.766265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:47.767905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b046964-77cc-4587-8983-7a69db5e30cf service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:47.779253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1063/2096] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:51.308318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:51.372202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92592888-67ef-4376-8e45-fa71df895f77 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:51.376910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:51.377797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:51.378080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:51.378358 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] PATH_INFO: `/v3/users/579a03998371422a91d48995203963ca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:51.379540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=579a03998371422a91d48995203963ca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:51.381647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:51.434651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579a03998371422a91d48995203963ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:51.435291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579a03998371422a91d48995203963ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:51.435924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579a03998371422a91d48995203963ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:51.444215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579a03998371422a91d48995203963ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:51.454166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579a03998371422a91d48995203963ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:51.456330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:51.474902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1034/2097] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:51 2022] DELETE /identity/v3/users/579a03998371422a91d48995203963ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:51.479545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:51.480021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:51.480308 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:51.497867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:51.499074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:51.558417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1064/2098] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:51.568935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:51.570496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:51.631498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33ea6-3ecd-42c9-bdeb-9f47fa84e24a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:51.635708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:51.636363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:51.636683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:51.636960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:51.646621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:51.648338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:51.659314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1035/2099] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:51.988580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:51.990431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.005502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d9cc-bf8c-45ee-9c0c-33c01a8804ad None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.014882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.015884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.016234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.016645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] PATH_INFO: `/v3/projects/12f487e7f03b48378b4d462380fb3db6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.017938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f487e7f03b48378b4d462380fb3db6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.020697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.074125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f487e7f03b48378b4d462380fb3db6', 'request_id': 'req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.080797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f487e7f03b48378b4d462380fb3db6', 'request_id': 'req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.086383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f487e7f03b48378b4d462380fb3db6', 'request_id': 'req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.099591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] The token cache is being invalidate because project 12f487e7f03b48378b4d462380fb3db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:52.099874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.100509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.102240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1065/2100] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:51 2022] DELETE /identity/v3/projects/12f487e7f03b48378b4d462380fb3db6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:52.105910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.116713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa301285-c8c2-4675-8b98-62088d09916c service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.180895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.181775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.182053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.182352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] PATH_INFO: `/v3/users/a9aaf3b10675423da8bbaf7469dc54a3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.183557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9aaf3b10675423da8bbaf7469dc54a3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.185523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.241225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9aaf3b10675423da8bbaf7469dc54a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.242067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9aaf3b10675423da8bbaf7469dc54a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.244626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9aaf3b10675423da8bbaf7469dc54a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.251956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9aaf3b10675423da8bbaf7469dc54a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.261213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47666da8-d27c-49ac-ac70-2ea6ed6eed22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9aaf3b10675423da8bbaf7469dc54a3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.279244 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1036/2101] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:52 2022] DELETE /identity/v3/users/a9aaf3b10675423da8bbaf7469dc54a3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:52.374576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.377221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.391847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbeb15-b2d8-45e3-a4d8-3e23ffa2ea96 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.447049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:52.457378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.458526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.458966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.459461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] PATH_INFO: `/v3/users/d48c7485e7c0402ba8409ca74685d056` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.460825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48c7485e7c0402ba8409ca74685d056)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.462900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.521153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48c7485e7c0402ba8409ca74685d056'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.522435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48c7485e7c0402ba8409ca74685d056'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.523032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48c7485e7c0402ba8409ca74685d056'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.530745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48c7485e7c0402ba8409ca74685d056'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.539372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48c7485e7c0402ba8409ca74685d056'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.560718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1066/2102] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:52 2022] DELETE /identity/v3/users/d48c7485e7c0402ba8409ca74685d056 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:52.565595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.566081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.566337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.574785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:52.578117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.579567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.588942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:52.590282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.648967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d76e-1873-4573-ae1c-2055b6c4dad6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.653765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.654642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.654928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.655205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] PATH_INFO: `/v3/projects/261a420222b74a90af5fe5e7b10adbf8` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.656373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=261a420222b74a90af5fe5e7b10adbf8)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.658333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.662023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1037/2103] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:52.672114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.675461 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.716710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261a420222b74a90af5fe5e7b10adbf8', 'request_id': 'req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.724684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261a420222b74a90af5fe5e7b10adbf8', 'request_id': 'req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.730191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261a420222b74a90af5fe5e7b10adbf8', 'request_id': 'req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.735543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdbc8a-4b85-448d-8460-f323d5782d66 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.743671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] The token cache is being invalidate because project 261a420222b74a90af5fe5e7b10adbf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:52.743913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.744595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5f5f7bf8-cba0-4c1b-be0d-41ad03eeb24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:52.746193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1067/2104] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:52 2022] DELETE /identity/v3/projects/261a420222b74a90af5fe5e7b10adbf8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:52.750929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad2f4-b018-42b4-a613-864c896e4bed None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.751246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad2f4-b018-42b4-a613-864c896e4bed None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.751578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad2f4-b018-42b4-a613-864c896e4bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.758140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:52.774734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-9acad2f4-b018-42b4-a613-864c896e4bed None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:52.776058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9acad2f4-b018-42b4-a613-864c896e4bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.788683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.789315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.789597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.789905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.791770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.857369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1068/2105] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:52.863779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.865057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.865287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.865646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.865994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.875386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1038/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:13:52.888777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:52.890141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:52.902440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1069/2107] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:52.906807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.917217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb6d7-bc29-446e-b86a-e7ebeb98e884 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.921679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.922276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.922603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.922761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.923678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:52.924107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.926234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:52.937587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:52.945260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1039/2108] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:52.954205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:52.966906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e7bf6-8f83-4cae-9c8e-6b73b2f91c7c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:52.974686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:52.975577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:52.975925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:52.976270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:52.977123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:52.979986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.012015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1070/2109] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:52 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:53.016784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.029228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ecabf-3a33-4f35-940d-5a6e0dff6747 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.134201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.135199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.135712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.136104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.137034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.140013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.178642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1040/2110] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:53 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:53.180306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.197086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ab97-2930-4450-a693-28c7aa3c3eca admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.205591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.206297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.206579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.206856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.208294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.211463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.213376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:53.226810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.236298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd39ab-36cc-4c20-957f-f44ec18f8bf0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.244228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.245192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.245553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.245774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1071/2111] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:53.248588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] PATH_INFO: `/v3/projects/26a35f0aa329425fadddf6d36b51f1f8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.250317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.257893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a35f0aa329425fadddf6d36b51f1f8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.262341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.263625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b906-2eeb-45cf-8174-894dadf9162c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.272607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.273421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.273705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.276105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.276105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.276741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.305019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1072/2112] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:53.309761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.323275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1358-ae20-4ae3-8040-29da37d623f3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.328514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.329635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.329870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.330257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] PATH_INFO: `/v3/projects/3d99917e40644804a5564b2714466b01/users/719107cb0ca547afa4b3f18c8a8c60d8/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.347821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d99917e40644804a5564b2714466b01, user_id=719107cb0ca547afa4b3f18c8a8c60d8, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.350661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c2a28-2e70-4117-b5ee-9918d5c9eacd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.353798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a35f0aa329425fadddf6d36b51f1f8', 'request_id': 'req-8e3ef837-b392-4f9f-8399-316004994eda'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:53.360963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a35f0aa329425fadddf6d36b51f1f8', 'request_id': 'req-8e3ef837-b392-4f9f-8399-316004994eda'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:53.366074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1073/2113] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:53 2022] PUT /identity/v3/projects/3d99917e40644804a5564b2714466b01/users/719107cb0ca547afa4b3f18c8a8c60d8/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:53.376225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a35f0aa329425fadddf6d36b51f1f8', 'request_id': 'req-8e3ef837-b392-4f9f-8399-316004994eda'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:53.377737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.378092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.378459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.390850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] The token cache is being invalidate because project 26a35f0aa329425fadddf6d36b51f1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:53.391739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:53.392557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:53.394265 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1041/2114] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:53 2022] DELETE /identity/v3/projects/26a35f0aa329425fadddf6d36b51f1f8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:53.416140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] MFA Rules not processed for user `719107cb0ca547afa4b3f18c8a8c60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:53.417774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:53.508325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1074/2115] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:53.513236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.514697 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:53.593438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef837-b392-4f9f-8399-316004994eda admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.606983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:53.653692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.654364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.654649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.654928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.655626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.657606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.696519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1042/2116] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:53.701871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.714060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4029-990c-4c64-8751-f42d7e813f3b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.728691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:53.776549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.777241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.777525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.777802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.778502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.780476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.801724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1075/2117] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:53 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:53.805790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.822211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9c1b-a6c9-4771-86ea-72eae8412107 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.828363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.830760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.831024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.831310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.832371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.834106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.846213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1043/2118] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:53.850519 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.861056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c4ca-5f7c-49db-80a4-45c3665bb4c3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.865940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.866834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.867119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.867399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] PATH_INFO: `/v3/projects/2a3e29c21f70468196795cf918527e34/users/19fd5495b26546b98598416d17b6bb75/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.882446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3e29c21f70468196795cf918527e34, user_id=19fd5495b26546b98598416d17b6bb75, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.885295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.900420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1076/2119] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:53 2022] PUT /identity/v3/projects/2a3e29c21f70468196795cf918527e34/users/19fd5495b26546b98598416d17b6bb75/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:53.904566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:53.916409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600372b2-45fb-48ab-9504-c239ea197398 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:53.980940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:53.981620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:53.981905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:53.982185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:53.982951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:53.984644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71090d0-3753-4e01-b4b9-76263ec6661b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:53.994777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1044/2120] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:53.999152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:54.010331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395e0e-79aa-4967-9d91-1b933da16b3a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:54.015283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:54.016207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.016484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.016788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] PATH_INFO: `/v3/projects/2a3e29c21f70468196795cf918527e34/users/19fd5495b26546b98598416d17b6bb75/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.018823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3e29c21f70468196795cf918527e34, user_id=19fd5495b26546b98598416d17b6bb75, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:54.021565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:54.033669 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1077/2121] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:53 2022] PUT /identity/v3/projects/2a3e29c21f70468196795cf918527e34/users/19fd5495b26546b98598416d17b6bb75/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:54.050824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.051127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.051575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.089351 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] MFA Rules not processed for user `19fd5495b26546b98598416d17b6bb75`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:54.090591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:54.166807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1045/2122] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:54.178249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:54.179999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:54.241132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd9bf-1a87-493c-84d4-532aab0aa8b0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:54.246240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:54.247018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.247300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.247606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.260118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:54.261681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4209-68b0-4328-8262-2ac3daccf464 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:54.271907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1078/2123] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:54.338202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:54.351722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:54.403541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a104-3180-4dbc-bdd5-429fca26ac0b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:54.409582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:54.410508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.410811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.411090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] PATH_INFO: `/v3/users/719107cb0ca547afa4b3f18c8a8c60d8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.412759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=719107cb0ca547afa4b3f18c8a8c60d8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:54.415684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:54.467894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719107cb0ca547afa4b3f18c8a8c60d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:54.468577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719107cb0ca547afa4b3f18c8a8c60d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:54.469200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719107cb0ca547afa4b3f18c8a8c60d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:54.476219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719107cb0ca547afa4b3f18c8a8c60d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:54.490541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719107cb0ca547afa4b3f18c8a8c60d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:54.512671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1046/2124] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:54 2022] DELETE /identity/v3/users/719107cb0ca547afa4b3f18c8a8c60d8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:54.517554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.517837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.518138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.538541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:54.539972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:54.602081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1079/2125] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:13:54.612405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:54.614125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:54.677047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd39f6-4b41-448e-81a9-528d08169a7b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:54.680985 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:54.681635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:54.681915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:54.682189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:54.693852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:54.695311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:54.708708 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1047/2126] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:13:54.985654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:54.988183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:55.003420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85dc8-9bc8-482a-96af-c4ec5c0d1ed1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:55.008908 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:55.009810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.010116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.010429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] PATH_INFO: `/v3/projects/3d99917e40644804a5564b2714466b01` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.011585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d99917e40644804a5564b2714466b01)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:55.013660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:55.022155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.066285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d99917e40644804a5564b2714466b01', 'request_id': 'req-084cd501-417f-483f-912c-b69360f4bb5d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.072757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d99917e40644804a5564b2714466b01', 'request_id': 'req-084cd501-417f-483f-912c-b69360f4bb5d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.078791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d99917e40644804a5564b2714466b01', 'request_id': 'req-084cd501-417f-483f-912c-b69360f4bb5d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.093027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] The token cache is being invalidate because project 3d99917e40644804a5564b2714466b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:55.093291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.093959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.095565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1080/2127] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:54 2022] DELETE /identity/v3/projects/3d99917e40644804a5564b2714466b01 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:55.099781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:55.109782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3598-fdbf-4a8e-8b87-2f3c8f7daf3b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:55.146449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.173314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:55.174203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.174480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.174851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] PATH_INFO: `/v3/users/19fd5495b26546b98598416d17b6bb75` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.176198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fd5495b26546b98598416d17b6bb75)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:55.178311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:55.231973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fd5495b26546b98598416d17b6bb75'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.232562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fd5495b26546b98598416d17b6bb75'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.233180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fd5495b26546b98598416d17b6bb75'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.240123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fd5495b26546b98598416d17b6bb75'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.248290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-037101bc-82b9-4081-8f6f-225348dbe8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fd5495b26546b98598416d17b6bb75'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.265954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1048/2128] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:13:55 2022] DELETE /identity/v3/users/19fd5495b26546b98598416d17b6bb75 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:55.556533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:55.558159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:55.577787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cd501-417f-483f-912c-b69360f4bb5d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:55.642952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:55.643826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.644103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.644376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] PATH_INFO: `/v3/projects/2a3e29c21f70468196795cf918527e34` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.645610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3e29c21f70468196795cf918527e34)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:55.647540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:55.697427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3e29c21f70468196795cf918527e34', 'request_id': 'req-0f0546fc-e4ea-42a2-ac4d-6062c30df119'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.703917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3e29c21f70468196795cf918527e34', 'request_id': 'req-0f0546fc-e4ea-42a2-ac4d-6062c30df119'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.710186 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3e29c21f70468196795cf918527e34', 'request_id': 'req-0f0546fc-e4ea-42a2-ac4d-6062c30df119'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.727302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] The token cache is being invalidate because project 2a3e29c21f70468196795cf918527e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:13:55.727727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.728602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0f0546fc-e4ea-42a2-ac4d-6062c30df119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:13:55.735350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1081/2129] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:13:55 2022] DELETE /identity/v3/projects/2a3e29c21f70468196795cf918527e34 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:55.737188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.738180 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.738502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.762249 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:55.763534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:55.838409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1049/2130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:55.842820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.843109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.843387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.866203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:55.867412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:55.875460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1082/2131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:55.879712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:55.889498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec254b-a48d-49a9-9424-fbdf91461945 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:55.898095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:55.898773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.899052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.899386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.900126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:13:55.900433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:55.902071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:55.914393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1050/2132] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:13:55.919011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:55.929217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900e4a6-1600-4874-90a0-37a4c8ce78a9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:55.934454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:55.935116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:55.935421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:55.935894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:55.936403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:55.938366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:55.960278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.970479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1083/2133] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:13:55 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:13:55.973677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:55.984005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113c562-1596-4d37-8601-7faed0764131 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:56.024471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:56.044364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:56.045169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.045736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.046045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.046836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:56.049895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:56.075188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1051/2134] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:13:55 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:13:56.079411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:56.091998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbf0-5cdd-4662-9ba6-72d8cc5c96c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:56.098979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:56.099985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.100394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.100819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.101974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:56.103861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:56.114988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1084/2135] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:56.119730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:56.131458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6cd45-a6bd-4d36-8467-653a4de0d13c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:56.137649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:56.138328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.138607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.138871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.139599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:56.141252 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039f20e-0580-4eb9-9989-fc80f5bfdb79 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:56.153607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1052/2136] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:13:56.158060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:56.169290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfb15-8f0b-4481-97c3-a940dec2e456 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:56.174531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:56.175416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.175696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.175970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] PATH_INFO: `/v3/projects/01b999cddb854ceda05badaf96fcf8a0/users/106ad8ca6dbd4d6f9ba387ae5176cbdf/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.190483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b999cddb854ceda05badaf96fcf8a0, user_id=106ad8ca6dbd4d6f9ba387ae5176cbdf, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:56.193578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:56.211134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1085/2137] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:13:56 2022] PUT /identity/v3/projects/01b999cddb854ceda05badaf96fcf8a0/users/106ad8ca6dbd4d6f9ba387ae5176cbdf/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:13:56.222444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.222806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.223186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.250860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] MFA Rules not processed for user `106ad8ca6dbd4d6f9ba387ae5176cbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:13:56.252086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:56.318013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1053/2138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:13:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:13:56.329306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:13:56.331326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:13:56.405749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47fc51-73e1-4ca4-803f-0a481957df2f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:13:56.410709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:13:56.411379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:13:56.411670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:13:56.412020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:13:56.423443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:13:56.425057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70a8a-1231-4406-83af-4162da41089b service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:13:56.436074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1086/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:13:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:00.615873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:00.704223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529687fd-a805-41fd-9e97-6d7f885aadb1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:00.708948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:00.710083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:00.710267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:00.710542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] PATH_INFO: `/v3/users/106ad8ca6dbd4d6f9ba387ae5176cbdf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:00.711973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=106ad8ca6dbd4d6f9ba387ae5176cbdf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:00.715425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:00.770380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106ad8ca6dbd4d6f9ba387ae5176cbdf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:00.771038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106ad8ca6dbd4d6f9ba387ae5176cbdf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:00.771621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106ad8ca6dbd4d6f9ba387ae5176cbdf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:00.776596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:00.779663 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106ad8ca6dbd4d6f9ba387ae5176cbdf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:00.788728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106ad8ca6dbd4d6f9ba387ae5176cbdf'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:00.807226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1054/2140] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:00 2022] DELETE /identity/v3/users/106ad8ca6dbd4d6f9ba387ae5176cbdf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:00.811847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:00.812336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:00.812412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:00.829852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:00.831198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:00.890801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1087/2141] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:00.900654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:00.902186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:00.958702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f922-e587-4874-9cb0-b9405113a8ce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:00.962375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:00.963021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:00.963303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:00.963579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:00.973059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:00.974522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280d0ba-e093-4d56-b558-5b602d9f833a service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:00.985758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1055/2142] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:01.262655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:01.264409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:01.278182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d213cd-dda6-4cfe-97f4-be925da36e05 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:01.284960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:01.286049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:01.286335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:01.286594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] PATH_INFO: `/v3/projects/01b999cddb854ceda05badaf96fcf8a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:01.287925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b999cddb854ceda05badaf96fcf8a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:01.289927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:01.342955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b999cddb854ceda05badaf96fcf8a0', 'request_id': 'req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:01.349269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b999cddb854ceda05badaf96fcf8a0', 'request_id': 'req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:01.354190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:01.355598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b999cddb854ceda05badaf96fcf8a0', 'request_id': 'req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:01.374569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] The token cache is being invalidate because project 01b999cddb854ceda05badaf96fcf8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:01.375023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:01.375633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c7e054d2-b0b5-4f5e-98e3-4793aebc59db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:01.377405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1088/2143] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:01 2022] DELETE /identity/v3/projects/01b999cddb854ceda05badaf96fcf8a0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:04.325729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.326233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.326323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.327740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1056/2144] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:14:04.338266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.338692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.338853 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.363598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:04.364878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:04.401557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:04.403574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:04.437633 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1089/2145] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:04.449540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:04.451118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:04.465755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5be45a-94f9-4c2c-95bc-253ebd4b0361 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:04.478146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:04.478932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.479315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.479569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.485614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5924660-f0af-4945-87c8-a27e7d8a4db0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:04.489451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:04.491059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:04.491276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:04.492174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.492487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.492754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] PATH_INFO: `/v3/users/b38f935893cf43afb8ac9a247e76079e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.493980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38f935893cf43afb8ac9a247e76079e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:04.495906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:04.500782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1090/2146] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:04.546997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38f935893cf43afb8ac9a247e76079e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.547659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38f935893cf43afb8ac9a247e76079e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.548319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38f935893cf43afb8ac9a247e76079e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.555026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38f935893cf43afb8ac9a247e76079e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.563198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-148c6634-b6c5-4ea0-8813-d0b7ad1b2a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38f935893cf43afb8ac9a247e76079e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.571230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:04.583291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1057/2147] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:04 2022] DELETE /identity/v3/users/b38f935893cf43afb8ac9a247e76079e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:04.775097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:04.786461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbf20-472a-47f2-8916-08d1c13b1ab1 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:04.846334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:04.847213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.847497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.847773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] PATH_INFO: `/v3/projects/32c2857e5c574a10bde11546249b3145` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.848998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c2857e5c574a10bde11546249b3145)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:04.850920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:04.908037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c2857e5c574a10bde11546249b3145', 'request_id': 'req-d6ccb325-5ad0-448a-884b-e702ff0ee33b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.914548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c2857e5c574a10bde11546249b3145', 'request_id': 'req-d6ccb325-5ad0-448a-884b-e702ff0ee33b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.920536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c2857e5c574a10bde11546249b3145', 'request_id': 'req-d6ccb325-5ad0-448a-884b-e702ff0ee33b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.933926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] The token cache is being invalidate because project 32c2857e5c574a10bde11546249b3145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:04.934359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.935044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d6ccb325-5ad0-448a-884b-e702ff0ee33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:04.936835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1091/2148] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:04 2022] DELETE /identity/v3/projects/32c2857e5c574a10bde11546249b3145 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:04.942173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:04.942631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:04.942861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:04.962170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:04.963363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:05.022946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1058/2149] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:05.031563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.031848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.032140 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.038775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:05.055244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:05.056674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:05.067768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1092/2150] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:05.072523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.082601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708165ab-a404-426c-852e-f1fdf49ff532 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.087408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.088162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.088541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.088814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.089542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:05.089844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.091572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.107323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1059/2151] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:05.108816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.118408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e62f17-e755-4b3d-b3ae-cad4bbc5b849 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.123179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.123842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.124183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.124589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.125395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.127336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.154203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1093/2152] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:05.158401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.168892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52693-bfd7-4139-99fe-5571ad17c1d7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.227465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.228136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.228414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.228715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.229401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.231389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.255575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1060/2153] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:05.256823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.267139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc5e8-6377-4a16-ae2f-43951e05b41c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.272131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.272847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.273137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.273414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.274147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.275765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.288184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1094/2154] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:05.292668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.307411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b971-6320-41ff-809f-ef05bb730d98 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.312418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.313128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.313407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.313685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.314412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.316915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c91c0-fa9a-438d-a098-27ad18a9652a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.330021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1061/2155] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:05.334654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.348278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f3f6-99e7-4bac-ac42-ca3b248e6636 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.354182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.355237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.355629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.356144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] PATH_INFO: `/v3/projects/28b6c3b32e5e42e4880bd7c09bed8050/users/19e8ddc09317412ba41d19b7663631fb/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.374171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b6c3b32e5e42e4880bd7c09bed8050, user_id=19e8ddc09317412ba41d19b7663631fb, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.377184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.399143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1095/2156] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:05 2022] PUT /identity/v3/projects/28b6c3b32e5e42e4880bd7c09bed8050/users/19e8ddc09317412ba41d19b7663631fb/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:05.409979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.410267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.410694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.439615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] MFA Rules not processed for user `19e8ddc09317412ba41d19b7663631fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:05.448012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:05.501346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:05.539262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1062/2157] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:05.545721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.609464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510353e-4c06-4431-9770-b8f8a3323e19 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.614718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.615397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.615680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.616001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.616809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.618740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.647472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1096/2158] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:05.651830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.662880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e34d8-7dcc-42b1-b05a-b8a5416f25ef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.719179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.719771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.720054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.720327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.721049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.722983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.748863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1063/2159] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:05.753070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.763641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac197d-7f13-449a-969e-838d291cc963 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.768695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.769367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.769646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.769927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.770667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.772274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.784890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1097/2160] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:05.789449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.799973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a4f6-3b12-4f07-b85d-79637c7330b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.805789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.806705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.806999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.807272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] PATH_INFO: `/v3/projects/222bb3a9308047b0872591976d089a83/users/1d96311c2be6422db3c13ec2cbfd7959/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.823256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=222bb3a9308047b0872591976d089a83, user_id=1d96311c2be6422db3c13ec2cbfd7959, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.826037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.843360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1064/2161] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:05 2022] PUT /identity/v3/projects/222bb3a9308047b0872591976d089a83/users/1d96311c2be6422db3c13ec2cbfd7959/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:05.848169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.859128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a673d0-9c02-42c5-b56c-5813a9ecb26e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.918247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.919101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.919480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.919889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.920742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.922351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccecb1-6929-4751-9543-e6e0a63307c4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.935012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1098/2162] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:05.939384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:05.950814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11815bd3-51bc-4e9f-9591-c16388fd635a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:05.956493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:05.957396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.957801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.958086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] PATH_INFO: `/v3/projects/222bb3a9308047b0872591976d089a83/users/1d96311c2be6422db3c13ec2cbfd7959/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:05.960254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222bb3a9308047b0872591976d089a83, user_id=1d96311c2be6422db3c13ec2cbfd7959, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:05.963139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:05.977283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1065/2163] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:05 2022] PUT /identity/v3/projects/222bb3a9308047b0872591976d089a83/users/1d96311c2be6422db3c13ec2cbfd7959/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:05.988583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:05.988924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:05.989344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:06.016996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:06.028680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] MFA Rules not processed for user `1d96311c2be6422db3c13ec2cbfd7959`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:06.033284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:06.111936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1099/2164] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:06.124915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:06.127222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:06.188857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8e64-5d85-498e-b29d-0f73850e8ba3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:06.193332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:06.194007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:06.194293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:06.194553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:06.204543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:06.205998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b6ae0-659a-49ca-93e9-a00316d47e2d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:06.216154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1066/2165] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:06.409671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:06.501963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecccce-0f9f-4723-9327-3e1ef6ba8197 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:06.508117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:06.509168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:06.509490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:06.509847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] PATH_INFO: `/v3/users/19e8ddc09317412ba41d19b7663631fb` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:06.511287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e8ddc09317412ba41d19b7663631fb)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:06.513692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:06.578172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e8ddc09317412ba41d19b7663631fb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:06.578910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e8ddc09317412ba41d19b7663631fb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:06.579544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e8ddc09317412ba41d19b7663631fb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:06.590984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e8ddc09317412ba41d19b7663631fb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:06.611254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e8ddc09317412ba41d19b7663631fb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:06.643481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1100/2166] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:06 2022] DELETE /identity/v3/users/19e8ddc09317412ba41d19b7663631fb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:06.644940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:06.645361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:06.645507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:06.670648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:06.671881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:06.716118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:06.740729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1067/2167] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:06.752179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:06.753855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:06.769203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:06.814536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e40f8-7368-4527-9022-63eae627f881 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:06.818838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:06.819466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:06.819808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:06.820079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:06.829627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:06.831065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:06.842276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1101/2168] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:07.137521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:07.139005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:07.151645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bff49-d757-428e-80e7-b9068826c39b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:07.157585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:07.158602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:07.158914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:07.159210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] PATH_INFO: `/v3/projects/28b6c3b32e5e42e4880bd7c09bed8050` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:07.160695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b6c3b32e5e42e4880bd7c09bed8050)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:07.163024 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:07.213653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b6c3b32e5e42e4880bd7c09bed8050', 'request_id': 'req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.220027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b6c3b32e5e42e4880bd7c09bed8050', 'request_id': 'req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.228676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b6c3b32e5e42e4880bd7c09bed8050', 'request_id': 'req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.241045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] The token cache is being invalidate because project 28b6c3b32e5e42e4880bd7c09bed8050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:07.241335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.241966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.243523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1068/2169] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:07 2022] DELETE /identity/v3/projects/28b6c3b32e5e42e4880bd7c09bed8050 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:07.247781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:07.258910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452767a-dd6f-4d62-b3b2-be98e70b18f2 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:07.336933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:07.337859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:07.338141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:07.338421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] PATH_INFO: `/v3/users/1d96311c2be6422db3c13ec2cbfd7959` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:07.339612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d96311c2be6422db3c13ec2cbfd7959)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:07.341783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:07.388847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d96311c2be6422db3c13ec2cbfd7959'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.389609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d96311c2be6422db3c13ec2cbfd7959'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.390363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d96311c2be6422db3c13ec2cbfd7959'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.397523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d96311c2be6422db3c13ec2cbfd7959'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.405420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-931c311f-fb46-4615-b2c2-750b11690691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d96311c2be6422db3c13ec2cbfd7959'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.422429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1102/2170] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:07 2022] DELETE /identity/v3/users/1d96311c2be6422db3c13ec2cbfd7959 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:07.709632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:07.712028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:07.732772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d16bb6-6cce-4ed2-9a8b-b3854888d2d7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:07.815354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:07.817339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:07.817494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:07.818516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] PATH_INFO: `/v3/projects/222bb3a9308047b0872591976d089a83` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:07.821021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222bb3a9308047b0872591976d089a83)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:07.824189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:07.897215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222bb3a9308047b0872591976d089a83', 'request_id': 'req-6a590859-ad82-4cb0-a515-8c514baca7b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.902533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222bb3a9308047b0872591976d089a83', 'request_id': 'req-6a590859-ad82-4cb0-a515-8c514baca7b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.910926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222bb3a9308047b0872591976d089a83', 'request_id': 'req-6a590859-ad82-4cb0-a515-8c514baca7b4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.912955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:07.923381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] The token cache is being invalidate because project 222bb3a9308047b0872591976d089a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:07.923722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.924613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a590859-ad82-4cb0-a515-8c514baca7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:07.926333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1069/2171] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:07 2022] DELETE /identity/v3/projects/222bb3a9308047b0872591976d089a83 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:07.931445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:07.931728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:07.931999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:07.949792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:07.950993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:07.979909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:08.010101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1103/2172] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:08.019142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.019429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.019706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.038045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:08.039205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:08.047753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1070/2173] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:08.051980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.062299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e34ef-1bc9-4166-a5b1-8f8c6c3f7217 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.068570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.069266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.069550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.069824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.070596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:08.070901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.072505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.084552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1104/2174] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:08.088730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.098315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dcc72-57fc-4aa0-b724-452fead7f58b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.104229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.104914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.105196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.105463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.106158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.108100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.141956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1071/2175] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:08.146198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.156697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a55f0-fffa-4b14-beac-bba2c074db03 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.218588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.219251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.219527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.219803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.220514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.222531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.244479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1105/2176] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:08.248726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.261419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494572e4-ba44-4310-bb2d-cb43ae97a9d1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.266958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.267645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.267943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.268222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.268997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.270631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.282240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1072/2177] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:08.287033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.300585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd456d0-c148-44b3-b847-b4ba973844ee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.306836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.307565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.307897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.308216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.309002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.310673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bc978-6932-4cf4-87c6-9fafc82afc61 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.321597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1106/2178] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:08.325805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.336214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bde20-832e-44bf-9e84-fb20f97e6253 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.342125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.343022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.343329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.343634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] PATH_INFO: `/v3/projects/dc64a48b78634fcb9fa68457255c8d63/users/64e0888b9d594b0d87c10ddad973f347/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.360168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc64a48b78634fcb9fa68457255c8d63, user_id=64e0888b9d594b0d87c10ddad973f347, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.362954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.379208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1073/2179] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:08 2022] PUT /identity/v3/projects/dc64a48b78634fcb9fa68457255c8d63/users/64e0888b9d594b0d87c10ddad973f347/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:08.389920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.390215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.390473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.419067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] MFA Rules not processed for user `64e0888b9d594b0d87c10ddad973f347`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:08.420278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:08.488951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1107/2180] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:08.493624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.554628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b94e-b6fb-44e1-91ad-77bfddc90278 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.559140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.559840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.560127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.560403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.561119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.563047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.591917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1074/2181] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:08.596109 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.607062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ffbf-fa37-4704-9c36-1bffc18a4163 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.635930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:08.663619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.664294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.664613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.664893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.665591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.667537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.689029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1108/2182] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:08.693565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.704191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233aba-7e4d-4bd9-a200-cb9700250a73 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.709693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.710385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.710682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.710942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.711670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.713341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.724662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1075/2183] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:08.728719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.739042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9df19-c5bf-4af6-a6ec-e54e25914194 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.744174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.744891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.745170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.745444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.746176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.747866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bbc8c-50e4-45cf-9384-cda0a683faca admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.757835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1109/2184] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:08.762063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.772311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ec46-3778-4071-b062-3291fa915a06 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:08.777241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:08.778254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.778537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.778799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] PATH_INFO: `/v3/projects/af63147ebfb64699b8c10ca531d8fb3c/users/16d81962d400423fac000edb7d47eeb2/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.794033 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af63147ebfb64699b8c10ca531d8fb3c, user_id=16d81962d400423fac000edb7d47eeb2, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:08.796766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:08.811767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1076/2185] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:08 2022] PUT /identity/v3/projects/af63147ebfb64699b8c10ca531d8fb3c/users/16d81962d400423fac000edb7d47eeb2/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:08.823443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:08.823733 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:08.824014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:08.857515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] MFA Rules not processed for user `16d81962d400423fac000edb7d47eeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:08.858745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:08.937754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1110/2186] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:08.942642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:08.997029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:09.021372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36eff1-da1d-4cbe-97a3-4ce8c4c41a75 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.027670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.028391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.029228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.029228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.029678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.031677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.059602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1077/2187] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:08 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:09.063793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.076213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffcdf6-322f-4c8a-a968-e87620234791 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.135723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.136395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.136712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.136986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.137792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.139719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.160681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1111/2188] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:09 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:09.166741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.178228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6068f9-3227-4bb8-ac91-85ef8a8d4298 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.183078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.183735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.184032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.184309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.185074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.186694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.197901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1078/2189] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:09.202549 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.218452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301345a4-3cac-430c-8089-f1e0c2e18688 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.227202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.228583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.228992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.229389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] PATH_INFO: `/v3/projects/9267de77cca8470db69cd49f015b47dd/users/becbaa61bfc741a3a0ba46007153676d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.251052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9267de77cca8470db69cd49f015b47dd, user_id=becbaa61bfc741a3a0ba46007153676d, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.254038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.273068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1112/2190] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:09 2022] PUT /identity/v3/projects/9267de77cca8470db69cd49f015b47dd/users/becbaa61bfc741a3a0ba46007153676d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:09.277290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.292272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fd7-99a8-4ad0-9e63-af1df1862e06 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.354847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.355434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.355713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.355988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.356775 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.358399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081eff3-3cea-4de4-ad22-e4d80e8fa168 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.368128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1079/2191] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:09.372582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.379491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:09.383789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891272c4-0219-4df6-8d5e-526e26fde03f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.390031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.390999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.391343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.391691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] PATH_INFO: `/v3/projects/9267de77cca8470db69cd49f015b47dd/users/becbaa61bfc741a3a0ba46007153676d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.393727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9267de77cca8470db69cd49f015b47dd, user_id=becbaa61bfc741a3a0ba46007153676d, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.396430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.407271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1113/2192] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:09 2022] PUT /identity/v3/projects/9267de77cca8470db69cd49f015b47dd/users/becbaa61bfc741a3a0ba46007153676d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:09.417590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.417878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.418160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.449436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] MFA Rules not processed for user `becbaa61bfc741a3a0ba46007153676d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:09.450882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:09.521261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1080/2193] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:09.535671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:09.538494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:09.615404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80091199-4a6b-403f-9c80-843ed863b0c1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:09.621277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:09.622265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:09.622569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:09.622836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:09.633609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:09.635460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:09.649573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1114/2194] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:10.171434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:10.173023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:10.186546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392e2fe-0ad5-4ec0-90fe-932e89e9ab0d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:10.190881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:10.192090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:10.192729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:10.193177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:10.233050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:10.258269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:10.259729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5eca4-74b0-4d45-860d-5ca85fe3faed service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:10.268747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1081/2195] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:12.416953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:12.418737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:12.491595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f28f-83c0-44c8-ad1e-5343747f79a6 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:12.496289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:12.497216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:12.497500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:12.497779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] PATH_INFO: `/v3/users/a3c4f45d48f04af3a8d1f322e2d4b464` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:12.499007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c4f45d48f04af3a8d1f322e2d4b464)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:12.500986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:12.549149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c4f45d48f04af3a8d1f322e2d4b464'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:12.549910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c4f45d48f04af3a8d1f322e2d4b464'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:12.550628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c4f45d48f04af3a8d1f322e2d4b464'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:12.557497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c4f45d48f04af3a8d1f322e2d4b464'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:12.565209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c4f45d48f04af3a8d1f322e2d4b464'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:12.583538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1115/2196] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:12 2022] DELETE /identity/v3/users/a3c4f45d48f04af3a8d1f322e2d4b464 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:12.588073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:12.588618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:12.588715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:12.605689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:12.607079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:12.664007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1082/2197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:12.674208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:12.675919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:12.693121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:12.740299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f515-937b-4fde-8792-eb455ffdcbff admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:12.746317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:12.747249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:12.747639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:12.748032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:12.758224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:12.759696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e269c9-bf41-4f7b-be4f-8cad6353360d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:12.769232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1116/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:13.051077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.052678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:13.080119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45527d20-21bd-4bd2-ab82-3bc8b798f1ad None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.090094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.091017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.091333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.091636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] PATH_INFO: `/v3/projects/934b0ad5a08f40f2a5cd3f837d218a3a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.095239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934b0ad5a08f40f2a5cd3f837d218a3a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.097040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.188839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934b0ad5a08f40f2a5cd3f837d218a3a', 'request_id': 'req-a7226c90-1228-45ab-a118-4ca95b213248'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:13.195259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934b0ad5a08f40f2a5cd3f837d218a3a', 'request_id': 'req-a7226c90-1228-45ab-a118-4ca95b213248'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:13.204174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934b0ad5a08f40f2a5cd3f837d218a3a', 'request_id': 'req-a7226c90-1228-45ab-a118-4ca95b213248'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:13.217258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] The token cache is being invalidate because project 934b0ad5a08f40f2a5cd3f837d218a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:13.217840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:13.218418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a7226c90-1228-45ab-a118-4ca95b213248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:13.225413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.225571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.225888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.227354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1083/2199] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:13 2022] DELETE /identity/v3/projects/934b0ad5a08f40f2a5cd3f837d218a3a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:13.247060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:13.248782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:13.315187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1117/2200] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:13.323429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.323714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.323987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.342089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:13.343379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:13.351415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1084/2201] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:13.355542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.365608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177eeb0-73fa-46db-ab42-c9e0fbcafc9a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.370973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.371647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.371926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.372210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.372934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:13.373273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.374880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.386539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1118/2202] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:13.391046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.400403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31185-899c-4b42-b693-224b59f75fb9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.405480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.406125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.406402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.406657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.407350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.409301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.437493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1085/2203] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:13 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:13.442097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.452769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b409d-be55-4e4e-a20f-462b4b83a331 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.509567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.510251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.510536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.510819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.511480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.513504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.533725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1119/2204] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:13 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:13.537978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.548873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3341ac-23e4-4542-9a67-3d97b5029c14 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.554551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.555223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.555509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.555802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.556652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.558459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.569840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1086/2205] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:13.573824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.584327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0d4-565e-4c96-baf5-2c8ccd18a845 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.589995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.590703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.590988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.591268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.592009 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.593835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1b51-437f-4388-8655-39170efa3d2c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.604546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1120/2206] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:13.609233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.619571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804f8e-889e-4150-86d9-2de38228cf67 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.624538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.625437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.625720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.625995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] PATH_INFO: `/v3/projects/58ddaa60dc6049f396edcae65b9b4334/users/db23170c2c1c41448d4fed1ee9038d8a/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.643298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ddaa60dc6049f396edcae65b9b4334, user_id=db23170c2c1c41448d4fed1ee9038d8a, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.646076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.649283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:13.664087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1087/2207] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:13 2022] PUT /identity/v3/projects/58ddaa60dc6049f396edcae65b9b4334/users/db23170c2c1c41448d4fed1ee9038d8a/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:13.675448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.675746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.676027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.707543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] MFA Rules not processed for user `db23170c2c1c41448d4fed1ee9038d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:13.709048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:13.719157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:13.777599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1121/2208] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:13.789293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:13.791075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:13.849812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540504-7ed9-44f2-8752-17dc50b30ec2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:13.853880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:13.854540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:13.854825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:13.855104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:13.864317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:13.865796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcb86c-97a9-49fe-a3da-58b90f6ad863 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:13.874981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1088/2209] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:14.368225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:14.369716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:14.382405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0341b91-40b4-41a4-a680-b432f9bd109c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:14.386618 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:14.387259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:14.387538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:14.387808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:14.389718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:14.448365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:14.449831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:14.459081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1122/2210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:15.225122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230b13-3dc4-47a5-a120-cadced29cdc5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:15.225658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230b13-3dc4-47a5-a120-cadced29cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:15.225658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230b13-3dc4-47a5-a120-cadced29cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:15.244102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b230b13-3dc4-47a5-a120-cadced29cdc5 None None] MFA Rules not processed for user `db23170c2c1c41448d4fed1ee9038d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:15.245342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b230b13-3dc4-47a5-a120-cadced29cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:15.252967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1089/2211] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:16.597042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:16.598504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:16.664695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121a47-9d16-4e9c-913c-9aa53c16ec86 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:16.669477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:16.670653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:16.671065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:16.671372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] PATH_INFO: `/v3/users/64e0888b9d594b0d87c10ddad973f347` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:16.672833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e0888b9d594b0d87c10ddad973f347)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:16.675297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:16.724108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e0888b9d594b0d87c10ddad973f347'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:16.724833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e0888b9d594b0d87c10ddad973f347'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:16.725496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e0888b9d594b0d87c10ddad973f347'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:16.730212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:16.733427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e0888b9d594b0d87c10ddad973f347'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:16.742657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e0888b9d594b0d87c10ddad973f347'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:16.761013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1123/2212] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:16 2022] DELETE /identity/v3/users/64e0888b9d594b0d87c10ddad973f347 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:16.765986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0826-0590-4343-9560-5179c5681f8e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:16.766485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0826-0590-4343-9560-5179c5681f8e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:16.766583 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0826-0590-4343-9560-5179c5681f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:16.784376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-932d0826-0590-4343-9560-5179c5681f8e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:16.785633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-932d0826-0590-4343-9560-5179c5681f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:16.855222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1090/2213] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:16.868427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:16.870189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:16.932813 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c6b7-5ed7-4de1-b35d-226a662aabfb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:16.937564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:16.938235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:16.938607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:16.938890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:16.951928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:16.953744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:16.964284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1124/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:17.262429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0826-0590-4343-9560-5179c5681f8e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:17.263929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-932d0826-0590-4343-9560-5179c5681f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:17.277383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0826-0590-4343-9560-5179c5681f8e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:17.282831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:17.284560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:17.285027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:17.285585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] PATH_INFO: `/v3/projects/dc64a48b78634fcb9fa68457255c8d63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:17.287540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc64a48b78634fcb9fa68457255c8d63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:17.289999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:17.339367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc64a48b78634fcb9fa68457255c8d63', 'request_id': 'req-88ef0f98-5068-492a-be67-8b64989be6fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.344963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc64a48b78634fcb9fa68457255c8d63', 'request_id': 'req-88ef0f98-5068-492a-be67-8b64989be6fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.353730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc64a48b78634fcb9fa68457255c8d63', 'request_id': 'req-88ef0f98-5068-492a-be67-8b64989be6fb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.365151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] The token cache is being invalidate because project dc64a48b78634fcb9fa68457255c8d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:17.365366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.365996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.368333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1091/2215] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:17 2022] DELETE /identity/v3/projects/dc64a48b78634fcb9fa68457255c8d63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:17.372384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:17.382411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b27e6-d3e9-490d-bbf4-4a1b53680cbc service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:17.439250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:17.440139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:17.440425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:17.441074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] PATH_INFO: `/v3/users/16d81962d400423fac000edb7d47eeb2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:17.442295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d81962d400423fac000edb7d47eeb2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:17.444241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:17.497709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d81962d400423fac000edb7d47eeb2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.498719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d81962d400423fac000edb7d47eeb2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.499362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d81962d400423fac000edb7d47eeb2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.507497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d81962d400423fac000edb7d47eeb2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.516763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d81962d400423fac000edb7d47eeb2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:17.525327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:17.537486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1125/2216] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:17 2022] DELETE /identity/v3/users/16d81962d400423fac000edb7d47eeb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:17.987238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:17.989390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:18.008801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0f98-5068-492a-be67-8b64989be6fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:18.026466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:18.084748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:18.085806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:18.086275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:18.086632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] PATH_INFO: `/v3/projects/af63147ebfb64699b8c10ca531d8fb3c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:18.088047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af63147ebfb64699b8c10ca531d8fb3c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:18.090017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:18.154061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af63147ebfb64699b8c10ca531d8fb3c', 'request_id': 'req-b91ba265-0a86-46c5-9c35-86725a72adb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.164274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af63147ebfb64699b8c10ca531d8fb3c', 'request_id': 'req-b91ba265-0a86-46c5-9c35-86725a72adb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.175235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af63147ebfb64699b8c10ca531d8fb3c', 'request_id': 'req-b91ba265-0a86-46c5-9c35-86725a72adb4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.188585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] The token cache is being invalidate because project af63147ebfb64699b8c10ca531d8fb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:18.188896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.189555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.191600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1092/2217] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:17 2022] DELETE /identity/v3/projects/af63147ebfb64699b8c10ca531d8fb3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:18.196904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:18.198506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:18.212214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ae31-e91a-4ace-a801-7810f95948de admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:18.284814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:18.285967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:18.286336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:18.286684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] PATH_INFO: `/v3/users/becbaa61bfc741a3a0ba46007153676d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:18.287981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=becbaa61bfc741a3a0ba46007153676d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:18.290285 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:18.349440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becbaa61bfc741a3a0ba46007153676d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.350159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becbaa61bfc741a3a0ba46007153676d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.352956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becbaa61bfc741a3a0ba46007153676d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.368078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becbaa61bfc741a3a0ba46007153676d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.379016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b68e100a-3fd2-41e7-9bf7-90a5336974fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becbaa61bfc741a3a0ba46007153676d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.408541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1126/2218] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:18 2022] DELETE /identity/v3/users/becbaa61bfc741a3a0ba46007153676d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:18.710566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:18.712146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:18.732776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ba265-0a86-46c5-9c35-86725a72adb4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:18.817935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:18.818198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:18.818501 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:18.818777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] PATH_INFO: `/v3/projects/9267de77cca8470db69cd49f015b47dd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:18.820120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9267de77cca8470db69cd49f015b47dd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:18.822074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:18.885483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:18.886709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9267de77cca8470db69cd49f015b47dd', 'request_id': 'req-92cffc10-8dd7-410c-a152-01a0273313fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.898430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9267de77cca8470db69cd49f015b47dd', 'request_id': 'req-92cffc10-8dd7-410c-a152-01a0273313fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.913840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9267de77cca8470db69cd49f015b47dd', 'request_id': 'req-92cffc10-8dd7-410c-a152-01a0273313fa'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.949056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] The token cache is being invalidate because project 9267de77cca8470db69cd49f015b47dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:18.950213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.950929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92cffc10-8dd7-410c-a152-01a0273313fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:18.953405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1093/2219] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:18 2022] DELETE /identity/v3/projects/9267de77cca8470db69cd49f015b47dd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:18.960431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:18.960976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:18.961380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:18.985141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:18.986498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:19.073723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1127/2220] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:19.078282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.078759 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.079110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.099414 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:19.100754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:19.109313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1094/2221] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:19.113706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.128207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9cb47-4179-46bf-8064-d9d0678ef09c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.133264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.134202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.134481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.134826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.135645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:19.136023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.137881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.145259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:19.151310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1128/2222] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:19.156291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.166749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de083d4-a980-462e-aadb-b37682cc2e06 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.171577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.172590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.172590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.172928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.173553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.175563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.205052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1095/2223] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:19.209352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.221257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d746a-8bcb-4385-909f-7878767a139c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.282731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.283419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.283703 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.283978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.284860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.286927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.312514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1129/2224] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:19.314006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.325687 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75f07-067b-418b-a766-e294e11dcd92 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.331271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.332116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.332366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.332676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.333606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.335229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.346798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1096/2225] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:19.350899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.361515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063f440-d3d2-43cb-baa6-43b7cfeefc05 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.366613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.367416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.367761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.368068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.368856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.370476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcd330-38e5-4cda-9703-0de193d3d7bd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.381192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1130/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:19.385899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.396166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725fe0-2810-4168-b1be-cde59c8da5fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.400872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.401777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.402058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.402336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] PATH_INFO: `/v3/projects/e7200c56527e45d8936443e44a7552c0/users/04e9f9c2485c496f9401a31615e81e79/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.417081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7200c56527e45d8936443e44a7552c0, user_id=04e9f9c2485c496f9401a31615e81e79, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.419676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.435076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1097/2227] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:19 2022] PUT /identity/v3/projects/e7200c56527e45d8936443e44a7552c0/users/04e9f9c2485c496f9401a31615e81e79/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:19.447766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.448058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.448340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.483537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] MFA Rules not processed for user `04e9f9c2485c496f9401a31615e81e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:19.484807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:19.553849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1131/2228] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:19.560327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.628199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad05b1-ded1-4b5f-930c-fdc96be63f73 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.634745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.635540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.635803 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.636071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.636866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.638779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.672676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1098/2229] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:19.674343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.685861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406c09-7329-41a3-b7b8-2c12e215ebd7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.741403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.742086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.742719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.742719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.743319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.745281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.755316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:19.772226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1132/2230] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:19 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:19.773561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.794836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733ee2d-ca6d-497f-be9b-c44f99ce879e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.799633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.800314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.800633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.800921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.801666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.803287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.814325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1099/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:19.818915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.829213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640ceb3-fdbb-4b97-a87c-b16dcfd2dd57 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.833877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.834763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.835044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.835323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] PATH_INFO: `/v3/projects/da935840e4d649879df19c5c08e226ff/users/3f9f59eb992a42ba852447e99bb1d1a4/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.850580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da935840e4d649879df19c5c08e226ff, user_id=3f9f59eb992a42ba852447e99bb1d1a4, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.853324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.868623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1133/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:19 2022] PUT /identity/v3/projects/da935840e4d649879df19c5c08e226ff/users/3f9f59eb992a42ba852447e99bb1d1a4/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:19.872634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.882647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc739a94-9da4-4437-a4ea-2f3ad7a17c83 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.925812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:19.941966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.942643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.942925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.943197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.943928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.945599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d22030-2461-452d-992e-8631278ea81f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.955500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1100/2233] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:19.959766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:19.971225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6500d3-7ace-47ad-ac78-af253b1b0728 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:19.976701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:19.977833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:19.978114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:19.978390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] PATH_INFO: `/v3/projects/da935840e4d649879df19c5c08e226ff/users/3f9f59eb992a42ba852447e99bb1d1a4/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:19.980327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da935840e4d649879df19c5c08e226ff, user_id=3f9f59eb992a42ba852447e99bb1d1a4, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:19.983027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:19.995834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1134/2234] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:19 2022] PUT /identity/v3/projects/da935840e4d649879df19c5c08e226ff/users/3f9f59eb992a42ba852447e99bb1d1a4/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:20.010953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.011256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.011528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.042463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] MFA Rules not processed for user `3f9f59eb992a42ba852447e99bb1d1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:20.043690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.066121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.068152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.124818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1101/2235] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:20.136207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.137558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.141007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879ef25-1b79-446d-bf62-af0cc4a37542 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.146701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.147594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.147871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.148143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] PATH_INFO: `/v3/users/ef0e2dce9c7b4be092e57989b880820d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.149401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0e2dce9c7b4be092e57989b880820d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:20.151323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:20.195656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf977-dc07-497a-812d-44e7e5065fb5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.199319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.199980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.200085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0e2dce9c7b4be092e57989b880820d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.200266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.200575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.200788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0e2dce9c7b4be092e57989b880820d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.201490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0e2dce9c7b4be092e57989b880820d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.202398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.208531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0e2dce9c7b4be092e57989b880820d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.214733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:20.216262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098d8b-2b38-4c2d-976e-d3fbfaf35d38 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:20.216379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0e2dce9c7b4be092e57989b880820d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.226068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1102/2236] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:20.234214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1135/2237] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:20 2022] DELETE /identity/v3/users/ef0e2dce9c7b4be092e57989b880820d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:20.238902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.239193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.239471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.258218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:20.259436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.329046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1103/2238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:20.336957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.338505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.382820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:20.400337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d01f7-3406-4b43-8c99-f5508d8ec59a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.404900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.405526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.405846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.406123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.416132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:20.417750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:20.428592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1136/2239] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:20.595391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.597243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.609385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35e799-2b98-4eab-aef0-30a87af48e71 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.614310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.615196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.615479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.615753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] PATH_INFO: `/v3/users/04e9f9c2485c496f9401a31615e81e79` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.617002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e9f9c2485c496f9401a31615e81e79)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:20.618946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:20.623715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:20.667737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e9f9c2485c496f9401a31615e81e79'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.668533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e9f9c2485c496f9401a31615e81e79'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.669193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e9f9c2485c496f9401a31615e81e79'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.676570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e9f9c2485c496f9401a31615e81e79'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.685195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f320690c-3ddf-4da7-80c3-066aa544e60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e9f9c2485c496f9401a31615e81e79'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.706434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1104/2240] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:20 2022] DELETE /identity/v3/users/04e9f9c2485c496f9401a31615e81e79 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:20.708632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.710027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.710743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.711194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.711496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.728759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc8dc-2a15-407c-859e-e0b82d1ee71d service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.730555 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:20.731859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.788266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.789182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.789467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.789819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] PATH_INFO: `/v3/projects/9a5c7e5178054b4a8d36a1d95b415399` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.791591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5c7e5178054b4a8d36a1d95b415399)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:20.793309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1105/2241] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:20.793921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:20.803338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:20.804816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.858976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5c7e5178054b4a8d36a1d95b415399', 'request_id': 'req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.866841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5c7e5178054b4a8d36a1d95b415399', 'request_id': 'req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.874513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5c7e5178054b4a8d36a1d95b415399', 'request_id': 'req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.889932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] The token cache is being invalidate because project 9a5c7e5178054b4a8d36a1d95b415399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:20.889932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.890655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e48d0c96-07c3-48c3-bcfb-646fdcc2fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:20.891981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac3b4-f300-4b0e-ae46-3e2f6f43e746 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:20.892707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1137/2242] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:20 2022] DELETE /identity/v3/projects/9a5c7e5178054b4a8d36a1d95b415399 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:20.897821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb05f-8ce0-44ab-93a5-19c3dfe7dfa9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.898206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb05f-8ce0-44ab-93a5-19c3dfe7dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.898637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eb05f-8ce0-44ab-93a5-19c3dfe7dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.917069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-2f3eb05f-8ce0-44ab-93a5-19c3dfe7dfa9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:20.918432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2f3eb05f-8ce0-44ab-93a5-19c3dfe7dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.937853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:20.951656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:20.953377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:20.954125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:20.954754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:20.958157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:20.997287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1138/2243] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:21.005458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.005748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.006027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.032011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.033816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.035386 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:21.036653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.049533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1106/2244] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:21.053768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1139/2245] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:21.057799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.068693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc51c-e3ba-4cbe-be10-edebe0ebefd9 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.073527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.074190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.074469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.074743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.075464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:21.075766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.077435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.089802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1107/2246] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:21.094326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.100161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:21.104737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3f55e-3ef8-44d3-98a3-5ff228280af7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.110382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.111102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.111645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.112326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.113236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.115290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.148490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1140/2247] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:21 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:21.152095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.162918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb041077-d690-4eb5-84f4-011f6c9930a3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.227018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.227726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.228103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.228456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.229177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.231119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.252560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1108/2248] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:21 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:21.256992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.268421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe7c73-2df6-4ff4-a106-165a1f6a2575 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.273089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.273759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.274038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.274315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.275071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.276717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.287242 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1141/2249] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:21.291211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.301743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339ef42-8c46-403b-87a9-131459309897 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.307516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.308264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.308642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.308962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.309784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.311594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.320713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.322573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.323532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1109/2250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:21.327694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.339959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ac0e-33dd-406e-933e-f5527bac7489 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.342550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5aa66-d3fd-48ac-b15b-337bb8610b73 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.347665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.348781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.349073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.349345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] PATH_INFO: `/v3/projects/e7200c56527e45d8936443e44a7552c0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.350156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.350522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7200c56527e45d8936443e44a7552c0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.351470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.351928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.352294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] PATH_INFO: `/v3/projects/4423635476624d8fb0d84bcc2a5bd3d8/users/56a56421c8a24be6925ac8b30a04906c/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.352435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.369579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4423635476624d8fb0d84bcc2a5bd3d8, user_id=56a56421c8a24be6925ac8b30a04906c, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.372977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9236d-0b96-446b-808f-87843b5f95bd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.388365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1110/2251] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:21 2022] PUT /identity/v3/projects/4423635476624d8fb0d84bcc2a5bd3d8/users/56a56421c8a24be6925ac8b30a04906c/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:21.398884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.399173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.399475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.406297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7200c56527e45d8936443e44a7552c0', 'request_id': 'req-fa62df73-afec-4fe9-8543-35fefb5f71ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.412441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7200c56527e45d8936443e44a7552c0', 'request_id': 'req-fa62df73-afec-4fe9-8543-35fefb5f71ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.418250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7200c56527e45d8936443e44a7552c0', 'request_id': 'req-fa62df73-afec-4fe9-8543-35fefb5f71ae'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.427582 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] MFA Rules not processed for user `56a56421c8a24be6925ac8b30a04906c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:21.429014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.432405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] The token cache is being invalidate because project e7200c56527e45d8936443e44a7552c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:21.432722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.433340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.437641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1142/2252] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:21 2022] DELETE /identity/v3/projects/e7200c56527e45d8936443e44a7552c0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:21.442878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.444681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.453574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:21.512543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1111/2253] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:21.512722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62df73-afec-4fe9-8543-35fefb5f71ae admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.517263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.518145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.518704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.518704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] PATH_INFO: `/v3/users/3f9f59eb992a42ba852447e99bb1d1a4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.519937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9f59eb992a42ba852447e99bb1d1a4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.521904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.524312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.525749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.572766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9f59eb992a42ba852447e99bb1d1a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.573491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9f59eb992a42ba852447e99bb1d1a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.574116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9f59eb992a42ba852447e99bb1d1a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.581281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9f59eb992a42ba852447e99bb1d1a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.583190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:21.585319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436a37-6525-4ca6-8bb0-f673beaf5201 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:21.589698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:21.589882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9f59eb992a42ba852447e99bb1d1a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:21.590389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:21.590684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:21.590973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:21.593060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.604304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:21.605786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4d84-366f-4be8-b07b-da8a77bafde7 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:21.609406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1143/2254] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:21 2022] DELETE /identity/v3/users/3f9f59eb992a42ba852447e99bb1d1a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:21.615958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1112/2255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:21.924837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:21.924837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:21.995740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebd2e-b8f3-452a-86c5-e6b013db821b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.001059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.001935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.002270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.002497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] PATH_INFO: `/v3/projects/da935840e4d649879df19c5c08e226ff` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.003704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da935840e4d649879df19c5c08e226ff)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.005696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.053946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da935840e4d649879df19c5c08e226ff', 'request_id': 'req-96c65758-265f-4b02-ac62-151c94ff6650'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:22.062145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da935840e4d649879df19c5c08e226ff', 'request_id': 'req-96c65758-265f-4b02-ac62-151c94ff6650'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:22.069422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da935840e4d649879df19c5c08e226ff', 'request_id': 'req-96c65758-265f-4b02-ac62-151c94ff6650'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:22.085481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] The token cache is being invalidate because project da935840e4d649879df19c5c08e226ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:22.085778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:22.086422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-96c65758-265f-4b02-ac62-151c94ff6650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:22.091834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1144/2256] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:21 2022] DELETE /identity/v3/projects/da935840e4d649879df19c5c08e226ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:22.094528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.094964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.095920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.116495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:22.117972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:22.180092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1113/2257] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:22.188134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.188424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.188757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.207515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:22.208790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:22.231732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1145/2258] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:22.236313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.246411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51a47c-d934-4b23-a733-61066cdd8dc2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.251326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.251996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.252329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.252592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.253305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:22.253674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.255302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.273735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1114/2259] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:14:22.274874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.285153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89cce-2ac1-408c-8711-b21fa56a366e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.290265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.291048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.291396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.292333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.293136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.295200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.333012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1146/2260] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:22.334924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.345417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe0a7-ce54-4a0d-908e-5dd206db448b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.400986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:22.412017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.412735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.413019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.413300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.414023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.415970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.442078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1115/2261] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:22.443554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.454555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1afcd-a870-4bdc-beb3-9f2cbf65a800 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.459461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.460132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.460429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.460817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.461602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.463238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.479520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1147/2262] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:22.485749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.496124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310075-11ad-42a0-9934-37f9e4f498de admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.501276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.501959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.502245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.502703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.503386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.505049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a770fa-dc7c-41fe-b161-2af53405726f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.516387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1116/2263] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:22.520711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.530907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592410bc-d712-4fd4-b5b4-ec13d2d26174 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.535653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.536591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.536872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.537151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] PATH_INFO: `/v3/projects/d9adc110347749199cb42fa91d35e607/users/6b213d30d9ef482fb16a006d0e465b6a/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.555012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9adc110347749199cb42fa91d35e607, user_id=6b213d30d9ef482fb16a006d0e465b6a, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.557724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.568295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:22.574000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1148/2264] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:22 2022] PUT /identity/v3/projects/d9adc110347749199cb42fa91d35e607/users/6b213d30d9ef482fb16a006d0e465b6a/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:22.584065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.584362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.584700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.611343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] MFA Rules not processed for user `6b213d30d9ef482fb16a006d0e465b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:22.612674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:22.678224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1117/2265] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:22.682732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.745603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91eaf9-bbe9-4fa8-9c77-6135de92d9fd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.750706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.751362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.751645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.751920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.752807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.754708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.782700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1149/2266] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:22.786906 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.798311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0ebf-1738-4991-8c2a-1a687ef76d78 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.859991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.860693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.860978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.861256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.861939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.863919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.884508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1118/2267] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:22 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:22.888736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.899288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bd130-2151-4c13-aed6-eef7e3bd7526 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.904927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.905599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.905882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.906139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.906899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.908577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.919368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1150/2268] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:22.924718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.935780 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1e274-9e51-4ab5-b1fd-fd9cd3c5c0c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:22.941411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:22.942334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:22.942619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:22.942889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] PATH_INFO: `/v3/projects/76ca62136fc044489a0dec8a2a6de97a/users/e506d0bf75c14aae9678462f517cb497/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:22.959245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca62136fc044489a0dec8a2a6de97a, user_id=e506d0bf75c14aae9678462f517cb497, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:22.961996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:22.978473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1119/2269] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:22 2022] PUT /identity/v3/projects/76ca62136fc044489a0dec8a2a6de97a/users/e506d0bf75c14aae9678462f517cb497/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:22.982442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:22.992816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453da2-535a-4e6e-8198-7f60274453d1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:23.050489 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:23.051401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:23.051685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:23.052058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:23.052739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:23.054337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d00f-f60e-453b-9a66-3b1df46ecd40 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:23.064416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1151/2270] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:23.069173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:23.079889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee57bdc-ef31-4252-a28e-d2f5447ce9d3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:23.086164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:23.087062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:23.087341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:23.087619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] PATH_INFO: `/v3/projects/76ca62136fc044489a0dec8a2a6de97a/users/e506d0bf75c14aae9678462f517cb497/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:23.089795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca62136fc044489a0dec8a2a6de97a, user_id=e506d0bf75c14aae9678462f517cb497, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:23.092503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:23.104004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1120/2271] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:23 2022] PUT /identity/v3/projects/76ca62136fc044489a0dec8a2a6de97a/users/e506d0bf75c14aae9678462f517cb497/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:23.115538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:23.115857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:23.116217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:23.142303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] MFA Rules not processed for user `e506d0bf75c14aae9678462f517cb497`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:23.143517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:23.212253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:23.223395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1152/2272] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:23.234411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:23.236110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:23.250014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:23.296264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01263f-f758-4acc-ae9b-d4f4c0da7941 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:23.300569 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:23.301261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:23.301657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:23.301941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:23.369344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:23.371091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:23.398740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1121/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:27.678085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:27.688513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45761-f371-461b-a169-2dcc38945103 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:27.692548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:27.693201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:27.693480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:27.693756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:27.703464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:27.704988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eab8dd-2b1c-43b1-bd3c-0296f6bb25b2 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:27.714753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1153/2274] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:32.661421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:32.719164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:32.719690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:32.719855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:32.739323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354cd4-efb4-4ad0-81b5-4542104b84d7 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:32.739503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:32.740690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:32.744338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:32.746071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:32.746071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:32.746376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] PATH_INFO: `/v3/users/6b213d30d9ef482fb16a006d0e465b6a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:32.748305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b213d30d9ef482fb16a006d0e465b6a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:32.750465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:32.805685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1154/2275] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:32.822915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b213d30d9ef482fb16a006d0e465b6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:32.823809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b213d30d9ef482fb16a006d0e465b6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:32.824404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b213d30d9ef482fb16a006d0e465b6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:32.832123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b213d30d9ef482fb16a006d0e465b6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:32.840819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-baddff0c-865b-4a53-9441-4c0623fb8683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b213d30d9ef482fb16a006d0e465b6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:32.845767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:32.850438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:32.851986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:32.860755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1122/2276] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:32 2022] DELETE /identity/v3/users/6b213d30d9ef482fb16a006d0e465b6a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:32.865277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:32.865566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:32.865846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:32.883467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:32.884768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:32.922845 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831f0b7-230b-472c-8b90-57a9d44c733a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:32.943771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1123/2277] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:32.954645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:32.956153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:32.996128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:32.996875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:32.997152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:32.997425 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:32.999347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:33.018765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b02df-84d8-4e05-b421-8efd9c9515e1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:33.022659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:33.023322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:33.023681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:33.023881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:33.033048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:33.035043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:33.036640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:33.047149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1124/2278] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:33.063822 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:33.066876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:33.075524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1155/2279] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:14:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 16:14:33.355586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:33.357202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:33.370832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736a8c-1385-4da9-8389-16a47f6e9355 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:33.376179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:33.377104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:33.377387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:33.377671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] PATH_INFO: `/v3/projects/d9adc110347749199cb42fa91d35e607` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:33.378955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9adc110347749199cb42fa91d35e607)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:33.381267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:33.433853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9adc110347749199cb42fa91d35e607', 'request_id': 'req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.439387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9adc110347749199cb42fa91d35e607', 'request_id': 'req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.447804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9adc110347749199cb42fa91d35e607', 'request_id': 'req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.478317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] The token cache is being invalidate because project d9adc110347749199cb42fa91d35e607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:33.478317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.479854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2e2dbf95-24a3-44ba-97c8-8650c4943dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.484056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1125/2280] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:33 2022] DELETE /identity/v3/projects/d9adc110347749199cb42fa91d35e607 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:33.489049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:33.501988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2838a94-7b88-4eb9-925a-90c4c9dbe842 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:33.569918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:33.570903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:33.571097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:33.571365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] PATH_INFO: `/v3/users/e506d0bf75c14aae9678462f517cb497` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:33.573058 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e506d0bf75c14aae9678462f517cb497)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:33.575073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:33.633789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e506d0bf75c14aae9678462f517cb497'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.635074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e506d0bf75c14aae9678462f517cb497'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.635765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e506d0bf75c14aae9678462f517cb497'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.644330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e506d0bf75c14aae9678462f517cb497'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.653599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e506d0bf75c14aae9678462f517cb497'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:33.674717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1156/2281] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:33 2022] DELETE /identity/v3/users/e506d0bf75c14aae9678462f517cb497 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:33.689454 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:33.690718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:33.691480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:33.710128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:33.711339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:33.717050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:33.774848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1126/2282] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:33.788882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:33.790977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:33.876330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:33.904073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f85e-560e-4631-accf-24d3ba34d80d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:33.909846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:33.910737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:33.911028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:33.911476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:33.922342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:33.925648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0c23d-1f9d-452e-b45c-3c021266ac7c service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:33.938017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1157/2283] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:14:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:34.110974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.112801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.185237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.185526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.185800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.196142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf9ab1-5b57-4bfa-9785-c10f7b045772 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.200719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.201613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.201885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.202164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] PATH_INFO: `/v3/projects/76ca62136fc044489a0dec8a2a6de97a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.203363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ca62136fc044489a0dec8a2a6de97a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.205069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:34.205417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.206429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.215964 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1158/2284] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:34.230343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.244071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ab68-133b-4a2d-97a5-f4c7d27a7c7b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.260515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ca62136fc044489a0dec8a2a6de97a', 'request_id': 'req-e2538668-454f-48dc-8fbf-9c289b2c7d33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:34.268818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ca62136fc044489a0dec8a2a6de97a', 'request_id': 'req-e2538668-454f-48dc-8fbf-9c289b2c7d33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:34.278344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ca62136fc044489a0dec8a2a6de97a', 'request_id': 'req-e2538668-454f-48dc-8fbf-9c289b2c7d33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:34.291658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] The token cache is being invalidate because project 76ca62136fc044489a0dec8a2a6de97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:34.291946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:34.292614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2538668-454f-48dc-8fbf-9c289b2c7d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:34.294165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1127/2285] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:34 2022] DELETE /identity/v3/projects/76ca62136fc044489a0dec8a2a6de97a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:34.300117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a7c9-3b5f-44fc-a1d7-6a4ddfab27a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.300404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a7c9-3b5f-44fc-a1d7-6a4ddfab27a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.300815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a7c9-3b5f-44fc-a1d7-6a4ddfab27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.311557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.312219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.312537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.312814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.315131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.320664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5718a7c9-3b5f-44fc-a1d7-6a4ddfab27a9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:34.321863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5718a7c9-3b5f-44fc-a1d7-6a4ddfab27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.363522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:34.379245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.381201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.383417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1128/2286] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:34.392579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.392881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.393167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.395060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1159/2287] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:14:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 16:14:34.416186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:34.417868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.428321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1129/2288] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:34.432798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.445276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368be22-ebb8-4613-92d4-697efaf7e146 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.450760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.451132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.451306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.451706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.453244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:34.453244 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.455240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.474819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1160/2289] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:34.475038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.485584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e202d-1822-4d02-8e77-05e2bec74e56 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.490445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.491220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.491602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.491807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.492652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.494738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.528480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1130/2290] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:34.530444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.540765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3171e7-59ad-4eaf-8ad3-93c2ad9ec140 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.600302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.601045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.601331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.601609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.602243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.604176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.611979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:34.626288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1161/2291] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:34.630628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.642334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fce45-a1bd-45ca-86b7-90756a92e875 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.648080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.648805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.649094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.649390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.650095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.651709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.662578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1131/2292] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:34.666987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.678932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b628-d3b7-412c-8063-a3cbdc0f9537 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.683755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.684429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.684757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.685039 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.685770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.687377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835336f-3964-4aab-a1e5-27508edc0abb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.698856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1162/2293] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:34.702874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.713677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c42b-b0c2-4934-b08c-a6e7a02b97b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.722002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.722916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.723195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.723467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] PATH_INFO: `/v3/projects/cedd6b590a70442b8df6e06dfe9799e0/users/436ec32d73394d27bf3f3c9127255830/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.738577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedd6b590a70442b8df6e06dfe9799e0, user_id=436ec32d73394d27bf3f3c9127255830, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.741448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877808-6b9e-405d-bcc7-bed75dd2315d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.746704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.747056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.747462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.756137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1132/2294] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:34 2022] PUT /identity/v3/projects/cedd6b590a70442b8df6e06dfe9799e0/users/436ec32d73394d27bf3f3c9127255830/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:34.767836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.768247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.768636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.771987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:34.773229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.795272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] MFA Rules not processed for user `436ec32d73394d27bf3f3c9127255830`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:34.797102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.829375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1163/2295] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:34.845032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.846492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:34.862936 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1133/2296] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:34.867320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.920589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf31ba-9f23-4ac2-bc4c-2ef21899d439 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.925942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.926643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.926926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.927201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.935936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.937030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c4ce-6652-478e-ad28-b3eee63a4fc9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:34.937572 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.942303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:34.943006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:34.943287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:34.943564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:34.944437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:34.946151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1164/2297] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:14:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 16:14:34.946449 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:34.970627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:34.979061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1134/2298] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:34.983079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:34.997231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291197-0a39-4925-b5c9-132aebccca84 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.061357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.062368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.062368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.062598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.063276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.065722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.100682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1165/2299] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:34 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:35.103237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:35.115838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d27736-10c6-42fb-a43b-14d41090265f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.132353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.133460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.134285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.135193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.136200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.138761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.155807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1135/2300] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:35.160660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:35.167670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:35.172211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b31f5-ede6-4776-b5ff-0dc7a0d73d4f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.190638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.190919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.192923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.193291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] PATH_INFO: `/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39/users/f4dcdf8e51d74732a5ff423f2fecbd44/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.213935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f39fa9fe33144a0bf6b5371d6829f39, user_id=f4dcdf8e51d74732a5ff423f2fecbd44, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.218951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.236303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1166/2301] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:35 2022] PUT /identity/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39/users/f4dcdf8e51d74732a5ff423f2fecbd44/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:35.240560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:35.261539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894f1bf-7fb8-4e6b-97d4-09a73caaf0ee admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.330070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.330770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.331050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.331321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.332043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.333694 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45e1f-7d7c-4163-8336-69afe42f6a40 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.347976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1136/2302] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:35.349436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:35.360106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c59ae-3e73-4729-b0a4-91bb3ce3666c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.365198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.366161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.366390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.366670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] PATH_INFO: `/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39/users/f4dcdf8e51d74732a5ff423f2fecbd44/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.368686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f39fa9fe33144a0bf6b5371d6829f39, user_id=f4dcdf8e51d74732a5ff423f2fecbd44, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.373882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.385040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1167/2303] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:35 2022] PUT /identity/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39/users/f4dcdf8e51d74732a5ff423f2fecbd44/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:35.396778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.397068 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.397348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.424908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] MFA Rules not processed for user `f4dcdf8e51d74732a5ff423f2fecbd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:35.426279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:35.507769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1137/2304] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:35.518625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:35.520408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:35.581709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69371e-f3ed-4f79-b055-96dd947c94f9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:35.585486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:35.586153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:35.586455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:35.586724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:35.653640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:35.655406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f9e0c-3210-4102-981b-0eba1b95ab51 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:35.668028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1168/2305] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:37.089809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:37.091291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.170153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ff2c-d4d3-4cec-a238-b6bec89d34b3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:37.175343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:37.176241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.176605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.179769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] PATH_INFO: `/v3/users/db23170c2c1c41448d4fed1ee9038d8a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.179769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db23170c2c1c41448d4fed1ee9038d8a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:37.180883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:37.192512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:37.240365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db23170c2c1c41448d4fed1ee9038d8a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.241046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db23170c2c1c41448d4fed1ee9038d8a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.241639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db23170c2c1c41448d4fed1ee9038d8a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.248548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db23170c2c1c41448d4fed1ee9038d8a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.257292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db23170c2c1c41448d4fed1ee9038d8a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.278407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1138/2306] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:37 2022] DELETE /identity/v3/users/db23170c2c1c41448d4fed1ee9038d8a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:37.284550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.285151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.285151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.307972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:37.309347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.371481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1169/2307] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:37.382138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:37.383764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.447157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5ca6-7d84-404b-9b91-dc4887119e16 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:37.451008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:37.451670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.451955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.452246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.462374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:37.463857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c67a6-a77f-4da1-86b2-82852678e839 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:37.475434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1139/2308] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:37.655534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:37.657072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.674226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e05670-123e-4a7e-8285-9d624dcb5bfb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:37.680663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:37.681768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.682066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.682344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] PATH_INFO: `/v3/projects/58ddaa60dc6049f396edcae65b9b4334` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.684031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ddaa60dc6049f396edcae65b9b4334)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:37.686043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:37.703641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:37.737686 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ddaa60dc6049f396edcae65b9b4334', 'request_id': 'req-d7bac459-ddc7-41e3-96f4-1db0a69b8558'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.744870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ddaa60dc6049f396edcae65b9b4334', 'request_id': 'req-d7bac459-ddc7-41e3-96f4-1db0a69b8558'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.750799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ddaa60dc6049f396edcae65b9b4334', 'request_id': 'req-d7bac459-ddc7-41e3-96f4-1db0a69b8558'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.764915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] The token cache is being invalidate because project 58ddaa60dc6049f396edcae65b9b4334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:37.765203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.765836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d7bac459-ddc7-41e3-96f4-1db0a69b8558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:37.767431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1170/2309] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:37 2022] DELETE /identity/v3/projects/58ddaa60dc6049f396edcae65b9b4334 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:37.773160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.773472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.773758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.793021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:37.794354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.867485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1140/2310] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:37.875057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.875342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.875651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.895338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:37.896619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:37.904937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1171/2311] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:37.909319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:37.919644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e767f13-bb91-4773-97a6-5b2bb38f9a61 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:37.924673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:37.925381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.925705 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.925988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.926907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:37.927237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:37.928970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:37.941977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1141/2312] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:14:37.946576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:37.956164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb957ca-52a4-45b9-84ed-e10856c224a6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:37.961303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:37.962524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:37.962524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:37.962524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:37.963211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:37.965183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:37.993783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1172/2313] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:37 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:37.998086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.009674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8a82-a386-4e10-8171-c6d719322b03 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.026257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:38.078171 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.078843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.079128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.079407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.080145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.082133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.108384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1142/2314] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:37 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:38.112565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.122868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acceba6-c13a-4136-82ea-f4dde7f6e34b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.127569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.128267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.128584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.129162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.129995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.131634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.143499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1173/2315] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:38.147483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.157825 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91347d9-a0f4-45bb-9915-65e6d20ab9a5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.163166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.163848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.164134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.164487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.165310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.166959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78495f-9941-4411-8d6a-d014976bc62b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.184428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1143/2316] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:38.189261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.201392 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813346b4-2151-41ef-bf06-766fad0f6867 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.206957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.208404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.208803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.209089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] PATH_INFO: `/v3/projects/8222c81f779645c687cf5c44e4e54fe4/users/ad37425a73ae44f2a4c0182267345b58/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.224794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8222c81f779645c687cf5c44e4e54fe4, user_id=ad37425a73ae44f2a4c0182267345b58, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.228117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.243604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1174/2317] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:38 2022] PUT /identity/v3/projects/8222c81f779645c687cf5c44e4e54fe4/users/ad37425a73ae44f2a4c0182267345b58/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:38.248916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.249468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.249812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.256840 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.258568 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.269419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:38.270967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.335993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0cb3-c6c9-4139-8754-a60cc5506494 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.341528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1144/2318] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:38.342749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.343661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.343953 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.344274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] PATH_INFO: `/v3/users/436ec32d73394d27bf3f3c9127255830` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.345681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436ec32d73394d27bf3f3c9127255830)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.347746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.351847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.353593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.404052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:38.406597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436ec32d73394d27bf3f3c9127255830'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:38.407723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436ec32d73394d27bf3f3c9127255830'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:38.408788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436ec32d73394d27bf3f3c9127255830'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:38.416789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436ec32d73394d27bf3f3c9127255830'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:38.418965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e238c6-2a6d-4a94-83e1-1b152f148b61 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.423350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.424336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.424747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.425011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.427455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.429967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-10632580-6807-49c2-92d2-cc9fa9dee164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436ec32d73394d27bf3f3c9127255830'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:38.443029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.444571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.450651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1175/2319] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:38 2022] DELETE /identity/v3/users/436ec32d73394d27bf3f3c9127255830 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:38.455126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.455463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.455844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1145/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:38.460806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.480231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:38.481504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.552918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1176/2321] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:38.564125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:38.566248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:38.578526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fb3d4-1350-42b7-89d3-11a76510e206 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:38.626813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:38.646232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:38.646959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:38.647247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:38.647529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:38.663140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:38.664625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:38.674948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1146/2322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:39.168899 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:39.170165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:39.182623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95704867-dc42-47e4-bbfd-0707c439e957 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:39.188069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:39.188980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:39.189261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:39.189534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] PATH_INFO: `/v3/projects/cedd6b590a70442b8df6e06dfe9799e0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:39.191235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedd6b590a70442b8df6e06dfe9799e0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:39.193250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:39.280559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedd6b590a70442b8df6e06dfe9799e0', 'request_id': 'req-a12576f5-3c02-4289-b975-a2c39b37d9a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.288120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedd6b590a70442b8df6e06dfe9799e0', 'request_id': 'req-a12576f5-3c02-4289-b975-a2c39b37d9a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.296032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedd6b590a70442b8df6e06dfe9799e0', 'request_id': 'req-a12576f5-3c02-4289-b975-a2c39b37d9a4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.313406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] The token cache is being invalidate because project cedd6b590a70442b8df6e06dfe9799e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:39.313914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.314791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a12576f5-3c02-4289-b975-a2c39b37d9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.316945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1177/2323] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:39 2022] DELETE /identity/v3/projects/cedd6b590a70442b8df6e06dfe9799e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:39.321310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:39.333011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095ebf-e767-4916-afcb-6eac3ff24566 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:39.340834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:39.341358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:39.344926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:39.377141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] MFA Rules not processed for user `ad37425a73ae44f2a4c0182267345b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:39.379517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:39.407445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:39.408786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:39.409214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:39.409642 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] PATH_INFO: `/v3/users/f4dcdf8e51d74732a5ff423f2fecbd44` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:39.410886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dcdf8e51d74732a5ff423f2fecbd44)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:39.413051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:39.418630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:39.464010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1178/2324] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:39.475628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:39.477011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dcdf8e51d74732a5ff423f2fecbd44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.477239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:39.477688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dcdf8e51d74732a5ff423f2fecbd44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.478346 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dcdf8e51d74732a5ff423f2fecbd44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.487646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dcdf8e51d74732a5ff423f2fecbd44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.496861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dcdf8e51d74732a5ff423f2fecbd44'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:39.516230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1147/2325] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:39 2022] DELETE /identity/v3/users/f4dcdf8e51d74732a5ff423f2fecbd44 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:14:39.550274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6663b04-be68-4899-aac7-31c1a2b2e003 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:39.606086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:39.606956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:39.607245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:39.607526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:39.609406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:39.669103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:39.670451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d34f63-22ce-4a85-9e23-4fc3574775fa service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:39.680634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1179/2326] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:14:39.814502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:39.817336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:39.909943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8846a3-a43e-4966-aa2a-8f6cbc291b02 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:39.915236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:39.916255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:39.916571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:39.917271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] PATH_INFO: `/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:39.918122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f39fa9fe33144a0bf6b5371d6829f39)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:39.920574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:39.923299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:39.993519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f39fa9fe33144a0bf6b5371d6829f39', 'request_id': 'req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:40.002767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f39fa9fe33144a0bf6b5371d6829f39', 'request_id': 'req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:40.019205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f39fa9fe33144a0bf6b5371d6829f39', 'request_id': 'req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:40.038209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] The token cache is being invalidate because project 3f39fa9fe33144a0bf6b5371d6829f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:40.038707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:40.039736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f49c11c-f5ce-47a1-9c13-1e2d5e48a8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:40.042385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1148/2327] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:39 2022] DELETE /identity/v3/projects/3f39fa9fe33144a0bf6b5371d6829f39 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:40.047594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.047880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.048155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.072055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:40.073447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:40.116141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:40.135383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1180/2328] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:40.143072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.143361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.143637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.162391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:40.163590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:40.172523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1149/2329] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:40.176836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.187121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1485c4-b9fc-4cce-a5b3-aec324879be9 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.193506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.194171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.194452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.194725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.195459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:40.195772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.197483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.210274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1181/2330] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:40.214793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.224655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f9e1-e9b8-43a2-bac3-edcbdfa748aa None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.229880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.230530 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.230811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.231085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.231754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.233717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.260794 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1150/2331] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:40.265016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.276088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d587891-abbb-4279-a97f-5e0fc31e923c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.334248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.334942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.335205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.335485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.336171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.338197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.361203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1182/2332] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:40.365624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.376761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ddef-3f55-4821-99a4-8c0fefb70fdc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.381597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.382266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.382542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.382840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.383559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.385237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.395897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1151/2333] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:40.400174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.412309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4a96-8754-4155-adde-435635063419 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.418238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.418902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.419182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.419448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.420180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.421836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d661ac-55a5-459e-9d0e-2bc9e7cae2dc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.432297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1183/2334] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:40.436879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.449208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e459-e950-4d6c-b67d-f4c2d0cbba4a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.455286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.456210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.456516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.456789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] PATH_INFO: `/v3/projects/99ab9afe6e1c4aec9dd705de63b9fc45/users/6e7aa14a276b428282cecdadda37f65c/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.473299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ab9afe6e1c4aec9dd705de63b9fc45, user_id=6e7aa14a276b428282cecdadda37f65c, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.476057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.494462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1152/2335] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:40 2022] PUT /identity/v3/projects/99ab9afe6e1c4aec9dd705de63b9fc45/users/6e7aa14a276b428282cecdadda37f65c/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:40.506141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.506431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.506711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.540921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] MFA Rules not processed for user `6e7aa14a276b428282cecdadda37f65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:40.542867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:40.613924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1184/2336] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:40.618823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.688967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0d69-9af9-471e-8b0d-ff04a7d20859 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.694744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.695431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.695712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.695986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.696702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.698620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.726200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1153/2337] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:40.730343 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.741750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111eb1f-9443-4841-acac-8eac3853c369 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.780643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:40.801553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.802246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.802525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.802800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.803513 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.805585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.828907 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1185/2338] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:40.834110 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.847935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80edbc-79ec-489e-a01b-85fbf5769195 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.854907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.855594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.855875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.856151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.856960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.858590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.871170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1154/2339] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:40.875856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.891766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2982d8-1968-41ab-81e4-165235d41203 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.897785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.898459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.898736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.899008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.899738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.901547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dffd50-40d8-4f00-99a8-ccf64757b750 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.913589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1186/2340] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:40.918235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:40.923930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:40.930547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9b48-44f4-480b-9346-5caa8456cd78 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:40.936717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:40.937615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.937897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.938175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] PATH_INFO: `/v3/projects/6c4031290c474e5685feff4325230383/users/b36ec328fdfa429ab0f949b0d469b092/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:40.957276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4031290c474e5685feff4325230383, user_id=b36ec328fdfa429ab0f949b0d469b092, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:40.959886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9c3c5-fe9e-4962-a578-92e7719297b4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:40.975980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1155/2341] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:40 2022] PUT /identity/v3/projects/6c4031290c474e5685feff4325230383/users/b36ec328fdfa429ab0f949b0d469b092/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:40.987122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:40.987411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:40.987691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.016410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] MFA Rules not processed for user `b36ec328fdfa429ab0f949b0d469b092`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:41.017798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:41.088115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1187/2342] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:41.100717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.101155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.101519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.126831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] MFA Rules not processed for user `ad37425a73ae44f2a4c0182267345b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:41.128224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:41.155393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.194100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1156/2343] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:41.230029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7882f9-206a-49cd-aab7-a40924ed98ae None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.236724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.236904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.237238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.237590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.238420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.240483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.275719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1188/2344] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:41 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:14:41.280067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.291459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425aed-dfd5-4d3e-b829-b795f95a344c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.363770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.364267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.364742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.365065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.366018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.367980 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.394001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1157/2345] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:41 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:41.395193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.405789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763da069-7515-47bd-bcae-1e0771a8bb99 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.410498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.411168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.411451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.411728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.412550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.414138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.425304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1189/2346] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:41.429438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.439920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165b16d-b61c-4793-84af-d29346d21f89 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.449507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.450417 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.450704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.450987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] PATH_INFO: `/v3/projects/fdab205089364657b49aebef3270ffca/users/1c2d3a09699c4487a79d675c1b77cb79/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.467833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdab205089364657b49aebef3270ffca, user_id=1c2d3a09699c4487a79d675c1b77cb79, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.470488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.485732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1158/2347] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:41 2022] PUT /identity/v3/projects/fdab205089364657b49aebef3270ffca/users/1c2d3a09699c4487a79d675c1b77cb79/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:41.490062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.500632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fd0dc-4edf-40d2-9712-32e0410a4c18 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.524086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:41.570090 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.571093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.571401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.571685 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.572420 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.574074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91836f17-18d9-4388-a1bd-6c99411b5307 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.584370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1190/2348] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:41.588947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.599393 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434be41-08a2-46bd-9b29-d29644a69492 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.604130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.605135 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.605542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.605897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] PATH_INFO: `/v3/projects/fdab205089364657b49aebef3270ffca/users/1c2d3a09699c4487a79d675c1b77cb79/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.608027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdab205089364657b49aebef3270ffca, user_id=1c2d3a09699c4487a79d675c1b77cb79, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.610821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.623567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1159/2349] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:41 2022] PUT /identity/v3/projects/fdab205089364657b49aebef3270ffca/users/1c2d3a09699c4487a79d675c1b77cb79/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:41.634003 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.634298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.634583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.664195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] MFA Rules not processed for user `1c2d3a09699c4487a79d675c1b77cb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:41.665769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:41.742992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1191/2350] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:41.770659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:41.772543 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:41.824741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:41.845491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a5eba-fdee-4466-a7dc-d1d43d705a07 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:41.849478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:41.850173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:41.850459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:41.850735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:41.919026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:41.920585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:41.930305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1160/2351] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:43.451095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:43.452792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:43.468736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8bcc6-5674-464a-9b0e-30defd897479 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:43.470589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:43.471328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:43.471682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:43.472033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:43.532735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:43.534504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:43.544951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1192/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:44.128020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:44.137502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264c74-c240-4b64-a126-8115b92703c8 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:44.142102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:44.142752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:44.143037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:44.143309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:44.153652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:44.155201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeb7db-0223-470c-8f7d-c571314e6a0d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:44.166060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1161/2353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:48.127622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:48.174193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:48.194309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6b48-703c-4294-b310-265230edcfd7 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:48.199523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:48.200402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:48.200713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:48.201012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] PATH_INFO: `/v3/users/6e7aa14a276b428282cecdadda37f65c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:48.202265 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7aa14a276b428282cecdadda37f65c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:48.204179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:48.257194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7aa14a276b428282cecdadda37f65c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.257841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7aa14a276b428282cecdadda37f65c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.258429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7aa14a276b428282cecdadda37f65c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.266388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7aa14a276b428282cecdadda37f65c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.275453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7aa14a276b428282cecdadda37f65c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.294365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1193/2354] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:48 2022] DELETE /identity/v3/users/6e7aa14a276b428282cecdadda37f65c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:48.299114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:48.299629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:48.299629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:48.319713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:48.320944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:48.381159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1162/2355] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:48.391176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:48.392774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:48.451677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2741bf5-ff9e-4720-a348-a99ce35ef9c4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:48.456678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:48.457334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:48.457613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:48.457884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:48.467841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:48.469320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:48.479698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1194/2356] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:48.885462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:48.887141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:48.900177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57144b-2a23-40e3-98fd-068409e40fb4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:48.905755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:48.906640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:48.906911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:48.907203 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] PATH_INFO: `/v3/projects/99ab9afe6e1c4aec9dd705de63b9fc45` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:48.908520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ab9afe6e1c4aec9dd705de63b9fc45)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:48.910484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:48.974787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ab9afe6e1c4aec9dd705de63b9fc45', 'request_id': 'req-18ec8e7f-15e2-4514-b337-956d78882f34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.980166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ab9afe6e1c4aec9dd705de63b9fc45', 'request_id': 'req-18ec8e7f-15e2-4514-b337-956d78882f34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.988765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ab9afe6e1c4aec9dd705de63b9fc45', 'request_id': 'req-18ec8e7f-15e2-4514-b337-956d78882f34'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:48.996442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:49.000544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] The token cache is being invalidate because project 99ab9afe6e1c4aec9dd705de63b9fc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:49.000905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.001771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.003646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1163/2357] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:48 2022] DELETE /identity/v3/projects/99ab9afe6e1c4aec9dd705de63b9fc45 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:49.007796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:49.017451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60347-c951-443b-b57c-8bf3701d5487 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:49.075673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:49.076604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:49.076880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:49.077157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] PATH_INFO: `/v3/users/b36ec328fdfa429ab0f949b0d469b092` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:49.078376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36ec328fdfa429ab0f949b0d469b092)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:49.080355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:49.085206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:49.127800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36ec328fdfa429ab0f949b0d469b092'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.128578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36ec328fdfa429ab0f949b0d469b092'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.129101 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36ec328fdfa429ab0f949b0d469b092'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.136091 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36ec328fdfa429ab0f949b0d469b092'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.144555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36ec328fdfa429ab0f949b0d469b092'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.161635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1195/2358] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:49 2022] DELETE /identity/v3/users/b36ec328fdfa429ab0f949b0d469b092 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:49.447879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:49.449376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:49.466653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec8e7f-15e2-4514-b337-956d78882f34 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:49.531987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:49.532920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:49.533200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:49.533478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] PATH_INFO: `/v3/projects/6c4031290c474e5685feff4325230383` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:49.534884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4031290c474e5685feff4325230383)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:49.536865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:49.585983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4031290c474e5685feff4325230383', 'request_id': 'req-18805b85-262d-4daf-829b-f3f47d9f461f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.591376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4031290c474e5685feff4325230383', 'request_id': 'req-18805b85-262d-4daf-829b-f3f47d9f461f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.601234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4031290c474e5685feff4325230383', 'request_id': 'req-18805b85-262d-4daf-829b-f3f47d9f461f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.613088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] The token cache is being invalidate because project 6c4031290c474e5685feff4325230383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:49.613382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.614156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.615722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1164/2359] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:49 2022] DELETE /identity/v3/projects/6c4031290c474e5685feff4325230383 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:49.619861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:49.621460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:49.634827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08997960-b4f5-4712-a637-d4f614629718 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:49.694013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:49.694874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:49.695187 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:49.695433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] PATH_INFO: `/v3/users/1c2d3a09699c4487a79d675c1b77cb79` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:49.696701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2d3a09699c4487a79d675c1b77cb79)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:49.698644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:49.751674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2d3a09699c4487a79d675c1b77cb79'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.752321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2d3a09699c4487a79d675c1b77cb79'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.752948 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2d3a09699c4487a79d675c1b77cb79'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.760089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2d3a09699c4487a79d675c1b77cb79'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.769118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-1bb67f7b-6c36-41c5-8e83-91bbf96d0194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2d3a09699c4487a79d675c1b77cb79'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:49.788540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1196/2360] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:14:49 2022] DELETE /identity/v3/users/1c2d3a09699c4487a79d675c1b77cb79 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:50.176150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.178342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:50.225037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18805b85-262d-4daf-829b-f3f47d9f461f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.284820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.285710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.285992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.286275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] PATH_INFO: `/v3/projects/fdab205089364657b49aebef3270ffca` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.287560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdab205089364657b49aebef3270ffca)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.289556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.333061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:50.349005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdab205089364657b49aebef3270ffca', 'request_id': 'req-e31b1f3e-26df-4518-8a81-f76cc7d0b977'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:50.354958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdab205089364657b49aebef3270ffca', 'request_id': 'req-e31b1f3e-26df-4518-8a81-f76cc7d0b977'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:50.363647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdab205089364657b49aebef3270ffca', 'request_id': 'req-e31b1f3e-26df-4518-8a81-f76cc7d0b977'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:50.376787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] The token cache is being invalidate because project fdab205089364657b49aebef3270ffca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:14:50.377082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:50.377811 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e31b1f3e-26df-4518-8a81-f76cc7d0b977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:14:50.379528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1165/2361] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:14:50 2022] DELETE /identity/v3/projects/fdab205089364657b49aebef3270ffca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:50.384473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.385016 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.385131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.391847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:50.405026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:50.406850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:50.466395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1197/2362] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:50.474342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.474840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.474997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.494302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:50.495504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:50.504003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1166/2363] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:50.508972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.522422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df62f6-67a2-4178-97b1-23f7ed9e20e6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.528183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.528928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.529211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.529483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.530214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:14:50.530527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.532209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.544747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1198/2364] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:14:50.549295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.559219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe561da-5485-4f67-8e88-4bab68ffd916 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.565504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.566152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.566430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.566698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.567381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.569332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.597657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1167/2365] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:14:50 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:50.601918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.612408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea906c-e47e-4f5a-9104-4db703983ba4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.676331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.677019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.677307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.677573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.678255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.680167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.702139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1199/2366] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:14:50 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:14:50.706512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.717336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc174-a4d7-4245-a093-4034a61f2cfc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.722245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.722921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.723190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.723495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.724220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.725887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.737544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1168/2367] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:14:50.741503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.755352 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe4d8-f0e3-4077-9761-7d28365fb4f4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.760777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.761800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.762215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.762547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.763600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.766181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba84bef-f82f-4747-994a-7532076754e4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.781837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1200/2368] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:14:50.785845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.796218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249496-fe60-485b-a408-fe2cff80fcb6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:50.801800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:50.802542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.802836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.803094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] PATH_INFO: `/v3/projects/2c2ad095ef76429a93409fddbf3df5d4/users/4f239aa5dc764c6eb866659cea34ba29/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.820348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2ad095ef76429a93409fddbf3df5d4, user_id=4f239aa5dc764c6eb866659cea34ba29, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:50.823074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:50.838486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1169/2369] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:14:50 2022] PUT /identity/v3/projects/2c2ad095ef76429a93409fddbf3df5d4/users/4f239aa5dc764c6eb866659cea34ba29/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:14:50.843700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae732f8-21e0-4649-bb6a-167caebda689 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:50.843990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae732f8-21e0-4649-bb6a-167caebda689 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:50.844269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae732f8-21e0-4649-bb6a-167caebda689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:50.862344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-7ae732f8-21e0-4649-bb6a-167caebda689 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:50.863536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7ae732f8-21e0-4649-bb6a-167caebda689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:50.930488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1201/2370] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:14:50.942300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:50.944162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:51.001538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490e262-e61d-4e43-b8e2-060813f67f58 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:51.005599 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:51.006239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:51.006520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:51.006792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:51.016078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:51.017570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:51.027101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1170/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:51.754439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-9d46-449c-ade1-9e1f1caabcd0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:51.755011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-9d46-449c-ade1-9e1f1caabcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:51.755011 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-9d46-449c-ade1-9e1f1caabcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:51.773054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:51.783376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-16ee611e-9d46-449c-ade1-9e1f1caabcd0 None None] MFA Rules not processed for user `4f239aa5dc764c6eb866659cea34ba29`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:51.784591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-16ee611e-9d46-449c-ade1-9e1f1caabcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:51.855390 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1202/2372] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:51.866933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:14:51.868580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:51.931401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19440c-2470-49dd-a4b1-e61a441517f1 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:14:51.935369 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:14:51.936338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:51.936667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:51.936947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:51.946413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:14:51.947910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3abc-88dd-453f-b230-999ada49908c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:14:51.957133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1171/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:14:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:14:54.356081 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:54.356643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:54.356643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:54.374520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] MFA Rules not processed for user `4f239aa5dc764c6eb866659cea34ba29`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:54.375738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:54.383105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1203/2374] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:14:56.631058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6239-ae9b-4d1a-ae6e-1bebc0b82595 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:14:56.631620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6239-ae9b-4d1a-ae6e-1bebc0b82595 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:14:56.631741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6239-ae9b-4d1a-ae6e-1bebc0b82595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:14:56.637806 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:56.653410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-be7e6239-ae9b-4d1a-ae6e-1bebc0b82595 None None] MFA Rules not processed for user `9ea320dbf059485c9468a0e033b39d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:14:56.655532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be7e6239-ae9b-4d1a-ae6e-1bebc0b82595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:14:56.721473 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1172/2375] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:01.261088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:01.262826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:01.278098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9cb54-fd0f-4b78-8e16-9fc8090541a4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:01.283620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:01.284523 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:01.284847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:01.285120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] PATH_INFO: `/v3/users/56a56421c8a24be6925ac8b30a04906c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:01.286369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a56421c8a24be6925ac8b30a04906c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:01.288342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:01.350062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a56421c8a24be6925ac8b30a04906c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.350062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a56421c8a24be6925ac8b30a04906c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.350062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a56421c8a24be6925ac8b30a04906c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.353170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a56421c8a24be6925ac8b30a04906c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.362282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a56421c8a24be6925ac8b30a04906c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.383029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1204/2376] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:15:01 2022] DELETE /identity/v3/users/56a56421c8a24be6925ac8b30a04906c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:15:01.387709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:01.388194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:01.388303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:01.406280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:01.407510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:01.473820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1173/2377] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:15:01.482839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:01.484689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:01.545751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367838-39f0-47fa-bfb4-f306be578bdc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:01.549429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:01.550076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:01.550353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:01.550625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:01.559862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:01.561536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd632-5fe1-4cab-983c-bca0858c6a28 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:01.572604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1205/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:01.849011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:01.850490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:01.863577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049209b9-d3f9-4287-b189-049a372620e2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:01.869095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:01.869982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:01.870317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:01.870600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] PATH_INFO: `/v3/projects/4423635476624d8fb0d84bcc2a5bd3d8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:01.871878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4423635476624d8fb0d84bcc2a5bd3d8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:01.873876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:01.928408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4423635476624d8fb0d84bcc2a5bd3d8', 'request_id': 'req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.935048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4423635476624d8fb0d84bcc2a5bd3d8', 'request_id': 'req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.943596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4423635476624d8fb0d84bcc2a5bd3d8', 'request_id': 'req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.957350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] The token cache is being invalidate because project 4423635476624d8fb0d84bcc2a5bd3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:15:01.957643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.958342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f29b52e8-bd7b-45df-8dc1-d97fad6e36f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:01.959981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1174/2379] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:15:01 2022] DELETE /identity/v3/projects/4423635476624d8fb0d84bcc2a5bd3d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:15:11.568043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:11.953368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:16.792137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de604-f825-4450-86dd-35252330cb2d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:16.792716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de604-f825-4450-86dd-35252330cb2d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:16.792716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de604-f825-4450-86dd-35252330cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:16.822194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-589de604-f825-4450-86dd-35252330cb2d None None] MFA Rules not processed for user `4f239aa5dc764c6eb866659cea34ba29`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:16.823803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-589de604-f825-4450-86dd-35252330cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:16.904208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1206/2380] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:21.523531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82418f-d644-45f9-bd07-1b4fd622a552 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:21.524302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82418f-d644-45f9-bd07-1b4fd622a552 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:21.524554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82418f-d644-45f9-bd07-1b4fd622a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:21.607287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f82418f-d644-45f9-bd07-1b4fd622a552 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:21.609118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f82418f-d644-45f9-bd07-1b4fd622a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:21.715923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1175/2381] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:21.747316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589de604-f825-4450-86dd-35252330cb2d None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:21.748914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-589de604-f825-4450-86dd-35252330cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:21.839988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589de604-f825-4450-86dd-35252330cb2d None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:21.846031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:21.846693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:21.846971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:21.847245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:21.855724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:21.857360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:21.867005 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1207/2382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:27.670671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f127-8ddc-40a9-ab9a-1f62e9c7e8df None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:27.671294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f127-8ddc-40a9-ab9a-1f62e9c7e8df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:27.671294 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f127-8ddc-40a9-ab9a-1f62e9c7e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:27.691377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a130f127-8ddc-40a9-ab9a-1f62e9c7e8df None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:27.692621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a130f127-8ddc-40a9-ab9a-1f62e9c7e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:27.701753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1176/2383] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:27.724712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:27.726300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:27.773198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac43f42-ed70-47c4-92e3-c35469bc35a9 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:27.779787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:27.780752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:27.781038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:27.781517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:27.790126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:27.791810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:27.801756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1208/2384] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:32.027078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d9aa-a616-402a-a571-614c51e9018a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:32.027954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d9aa-a616-402a-a571-614c51e9018a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:32.028678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d9aa-a616-402a-a571-614c51e9018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:32.059202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0b87d9aa-a616-402a-a571-614c51e9018a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:32.060865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0b87d9aa-a616-402a-a571-614c51e9018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:32.071206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1177/2385] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:32.102286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:32.115134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0246-e071-4d93-b2c1-51421ab0ea02 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:32.132534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:32.133225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:32.133504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:32.133782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:32.140896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:32.143771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:32.145463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:32.157253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1209/2386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:38.191084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9ea5-33e9-4c04-b471-5157f0f0aec7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:38.191639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9ea5-33e9-4c04-b471-5157f0f0aec7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:38.191733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b9ea5-33e9-4c04-b471-5157f0f0aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:38.211133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-869b9ea5-33e9-4c04-b471-5157f0f0aec7 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:38.212493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-869b9ea5-33e9-4c04-b471-5157f0f0aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:38.223258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1178/2387] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:38.257774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:38.269073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448a4cb-041f-4e8b-a785-40167ac51fa2 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:38.275264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:38.275936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:38.276222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:38.276544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:38.291565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:38.299345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:38.313208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1210/2388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:40.017304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:40.017766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:40.017847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:40.046635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:40.047875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:40.104404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1179/2389] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:40.153834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:40.155950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:40.230540 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b299-00b0-4da3-95d1-4557fbbed253 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:40.236088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:40.236786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:40.237143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:40.237422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:40.245870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:40.247511 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e646f-c512-40e9-b8b3-af6d0b22424e service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:40.255951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1211/2390] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:41.223880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:41.226026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:41.249638 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:41.368433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00ef8-f46c-4d31-9ebc-f8ae8c51b1ee None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:41.374329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:41.375272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:41.375739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:41.376185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:41.378529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:41.393762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:41.397911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:41.412979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1180/2391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:42.423213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa0c6-5453-48ea-b658-91414177fe50 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:42.423863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa0c6-5453-48ea-b658-91414177fe50 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:42.424336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa0c6-5453-48ea-b658-91414177fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:42.448087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-cfafa0c6-5453-48ea-b658-91414177fe50 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:42.449901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cfafa0c6-5453-48ea-b658-91414177fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:42.460045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1212/2392] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:42.493187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:42.507860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1b4d-3741-45ec-a3eb-5c492d50bd83 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:42.518314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:42.519179 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:42.519564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:42.520116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:42.530224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:42.531768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:42.543610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1181/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:47.668990 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a65b6-0e7c-4479-aaec-cc7dca29f903 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:47.669996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a65b6-0e7c-4479-aaec-cc7dca29f903 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:47.670579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a65b6-0e7c-4479-aaec-cc7dca29f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:47.691506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e79a65b6-0e7c-4479-aaec-cc7dca29f903 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:47.693159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e79a65b6-0e7c-4479-aaec-cc7dca29f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:47.702199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1213/2394] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:47.724693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:47.743863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbbc8c-c72a-44a9-911a-a656f69dd303 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:47.750799 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:47.751472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:47.751757 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:47.752037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:47.763379 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:47.765158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:47.788641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1182/2395] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:51.101619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad638-6ecf-49f9-bfdf-5b9cc80c43ca None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:51.103048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad638-6ecf-49f9-bfdf-5b9cc80c43ca None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:51.103951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad638-6ecf-49f9-bfdf-5b9cc80c43ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:51.200404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ad0ad638-6ecf-49f9-bfdf-5b9cc80c43ca None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:51.201768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ad0ad638-6ecf-49f9-bfdf-5b9cc80c43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:51.224728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1214/2396] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:51.237404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:51.262774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813b08-687e-4a72-b5a6-b94ade36d023 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:51.268015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:51.268805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:51.269095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:51.269377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:51.282350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:51.284001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:51.302632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1183/2397] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:57.013614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042c92-0acf-4981-ba96-f5724141f290 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:57.014191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042c92-0acf-4981-ba96-f5724141f290 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:57.014191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042c92-0acf-4981-ba96-f5724141f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:57.035652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-10042c92-0acf-4981-ba96-f5724141f290 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:57.037019 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-10042c92-0acf-4981-ba96-f5724141f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:57.044374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1215/2398] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:15:57.058223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:57.076256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1acf-0860-4916-8dd0-f4cfe92fe641 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:57.081808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:57.082472 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:57.082754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:57.083133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:57.091704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:57.093330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f87f6-730a-40c7-8350-b288fce5f0fa service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:57.102306 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1184/2399] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:59.558445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:59.559419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:59.564067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:59.568884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1216/2400] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:15:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:15:59.575099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:59.575668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:59.575668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:59.661069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] MFA Rules not processed for user `0cfb966c12ea4f60a7682649c7a5cfee`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:15:59.663109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:59.672711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1185/2401] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:15:59.762917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:59.765248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:59.797167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be27a09-89d8-4631-8a96-ca3825cf658f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:59.817546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:59.818422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:59.818886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:59.819410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:59.822536 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:15:59.824409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:15:59.862117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8ee3b-1431-4932-b673-20745715fb16 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:15:59.863585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:59.865305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:59.880422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:15:59.881353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:15:59.881639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:15:59.881914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] PATH_INFO: `/v3/users/4f239aa5dc764c6eb866659cea34ba29` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:15:59.884512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f239aa5dc764c6eb866659cea34ba29)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:15:59.892360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:15:59.901100 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1217/2402] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:15:59.993120 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f239aa5dc764c6eb866659cea34ba29'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:59.994220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f239aa5dc764c6eb866659cea34ba29'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:15:59.997753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f239aa5dc764c6eb866659cea34ba29'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.008550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:00.011425 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f239aa5dc764c6eb866659cea34ba29'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.035773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0a963732-bf9d-47c0-bc91-d17095b6aed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f239aa5dc764c6eb866659cea34ba29'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.067723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1186/2403] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:15:59 2022] DELETE /identity/v3/users/4f239aa5dc764c6eb866659cea34ba29 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:16:00.537236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:00.549702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9acc-8835-43bd-ac26-bfcd99737ab5 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:00.663616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:00.665331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:00.665832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:00.666297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] PATH_INFO: `/v3/projects/2c2ad095ef76429a93409fddbf3df5d4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:00.667735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2ad095ef76429a93409fddbf3df5d4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:00.670213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:00.672195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:00.742080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2ad095ef76429a93409fddbf3df5d4', 'request_id': 'req-62ae883e-0d97-42ca-b99e-f49f6c552460'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.748577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2ad095ef76429a93409fddbf3df5d4', 'request_id': 'req-62ae883e-0d97-42ca-b99e-f49f6c552460'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.756038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2ad095ef76429a93409fddbf3df5d4', 'request_id': 'req-62ae883e-0d97-42ca-b99e-f49f6c552460'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.772872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] The token cache is being invalidate because project 2c2ad095ef76429a93409fddbf3df5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:16:00.773255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.773791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-62ae883e-0d97-42ca-b99e-f49f6c552460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:16:00.776128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1218/2404] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:16:00 2022] DELETE /identity/v3/projects/2c2ad095ef76429a93409fddbf3df5d4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:16:05.443144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da767-341c-491b-ad4d-6c0a5719c998 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:05.443671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da767-341c-491b-ad4d-6c0a5719c998 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:05.443765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da767-341c-491b-ad4d-6c0a5719c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:05.462871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2e0da767-341c-491b-ad4d-6c0a5719c998 None None] MFA Rules not processed for user `ad37425a73ae44f2a4c0182267345b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:05.464082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e0da767-341c-491b-ad4d-6c0a5719c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:05.523728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1187/2405] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:16:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:07.064510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.065097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.065097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.066573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1219/2406] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:16:07.072702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6214c9-6317-4c12-8c17-620275bfb6d0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.073213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6214c9-6317-4c12-8c17-620275bfb6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.073307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6214c9-6317-4c12-8c17-620275bfb6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.128786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff6214c9-6317-4c12-8c17-620275bfb6d0 None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:07.130221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff6214c9-6317-4c12-8c17-620275bfb6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:07.214047 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1188/2407] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:07.227528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:07.229468 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:07.317447 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89c90-1942-4bc9-9dea-0b9337359569 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:07.330942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:07.331632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.331931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.332211 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.347133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:07.350901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f25ae-7f0a-4120-820f-ecf2d8f58ee4 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:07.364224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1220/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:16:07.438152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.438448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.438731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.440146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1189/2409] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:16:07.445111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c2ac-a2ed-4b92-8aff-58b49aca825d None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.445400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c2ac-a2ed-4b92-8aff-58b49aca825d None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.445677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c2ac-a2ed-4b92-8aff-58b49aca825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.480605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c982c2ac-a2ed-4b92-8aff-58b49aca825d None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:07.482115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c982c2ac-a2ed-4b92-8aff-58b49aca825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:07.543698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1221/2410] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:16:07.555824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:07.557756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:07.571749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43732-20e2-40d4-b2da-1db78f491644 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:07.576090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:07.576800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.577079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.577350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.584868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:07.586303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0f956-682e-48d2-bdda-2785e11a592a service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:07.594438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1190/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:16:07.680349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d5fd-fab1-40c0-9fb8-f009e92f1266 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.680737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d5fd-fab1-40c0-9fb8-f009e92f1266 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.681014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d5fd-fab1-40c0-9fb8-f009e92f1266 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.682652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1222/2412] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:16:07.688256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e7cb-2c13-4a10-96cb-790b7e5bb8ee None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.688579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e7cb-2c13-4a10-96cb-790b7e5bb8ee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.688914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e7cb-2c13-4a10-96cb-790b7e5bb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.709463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2154e7cb-2c13-4a10-96cb-790b7e5bb8ee None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:07.710688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2154e7cb-2c13-4a10-96cb-790b7e5bb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:07.720048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1191/2413] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:07.731166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d5fd-fab1-40c0-9fb8-f009e92f1266 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:07.736989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:07.745064 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d5fd-fab1-40c0-9fb8-f009e92f1266 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:07.749947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:07.750668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:07.751012 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:07.751289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:07.762569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:07.764087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:07.775277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1223/2414] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:16:12.508147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e4e6-c3ec-4d55-96f8-9319c099e51a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:12.508653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e4e6-c3ec-4d55-96f8-9319c099e51a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:12.508820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e4e6-c3ec-4d55-96f8-9319c099e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:12.527104 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7ed2e4e6-c3ec-4d55-96f8-9319c099e51a None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:12.528301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7ed2e4e6-c3ec-4d55-96f8-9319c099e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:12.558027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:12.588478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1192/2415] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:12.603826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:12.605470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:12.690479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef95-c6b7-4543-b924-017f1e035863 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:12.696486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:12.697168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:12.697448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:12.697722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:12.712691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:12.714307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:12.722521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1224/2416] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:16:22.580007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=9 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:22.719263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=42 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:34.857145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c436-7363-4372-8264-d9e088f6cd86 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:34.857684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c436-7363-4372-8264-d9e088f6cd86 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:34.857855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206c436-7363-4372-8264-d9e088f6cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:34.877300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c206c436-7363-4372-8264-d9e088f6cd86 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:34.878912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c206c436-7363-4372-8264-d9e088f6cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:34.887398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1193/2417] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:34.901410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:34.911793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0a2a4-7245-4da0-98fb-8bd86e2fe18c service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:34.917010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:34.917766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:34.917931 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:34.918208 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:34.926848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:34.928389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:34.938452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1225/2418] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:16:36.416112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949ba9-3755-4df8-aaff-7be50a2cca02 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:36.416733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949ba9-3755-4df8-aaff-7be50a2cca02 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:36.416733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949ba9-3755-4df8-aaff-7be50a2cca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:36.442898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5a949ba9-3755-4df8-aaff-7be50a2cca02 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:36.444700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5a949ba9-3755-4df8-aaff-7be50a2cca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:36.508902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1194/2419] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:36.539537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:36.541195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:36.557843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281893-fde8-4f79-8100-58bb956c9e4e service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:36.565789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:36.566438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:36.566722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:36.566997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:36.575591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:36.577230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:36.586878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1226/2420] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:16:40.705822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15394f-452f-4b10-a7b8-2c173e8f0726 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:40.706400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15394f-452f-4b10-a7b8-2c173e8f0726 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:40.706400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15394f-452f-4b10-a7b8-2c173e8f0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:40.725601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f15394f-452f-4b10-a7b8-2c173e8f0726 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:40.726791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f15394f-452f-4b10-a7b8-2c173e8f0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:40.735273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1195/2421] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:40.755800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:40.757407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:40.772348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da6738-994b-45ee-a2e7-ca636e48ef0b service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:40.779007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:40.779654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:40.779952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:40.780226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:40.789227 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:40.790812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:40.800872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1227/2422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:16:44.914549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182873-0570-423c-b615-afe31905581f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:44.915407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182873-0570-423c-b615-afe31905581f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:44.915407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182873-0570-423c-b615-afe31905581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:44.938217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-42182873-0570-423c-b615-afe31905581f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:44.939523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-42182873-0570-423c-b615-afe31905581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:44.948641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1196/2423] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:44.975481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:44.988840 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980072e-8074-4840-930c-81b5244f8428 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:44.995803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:44.996499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:44.996766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:44.997040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:45.005657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:45.007247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:45.016972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1228/2424] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:16:49.128390 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bd2b-50e5-4096-9af2-7b639f4de01c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:49.129288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bd2b-50e5-4096-9af2-7b639f4de01c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:49.129288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bd2b-50e5-4096-9af2-7b639f4de01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:49.153251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7d30bd2b-50e5-4096-9af2-7b639f4de01c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:49.154865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7d30bd2b-50e5-4096-9af2-7b639f4de01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:49.165863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1197/2425] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:49.190358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:49.202195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa444-4e6d-49a3-aa8b-8bdbb1fca443 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:49.209331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:49.209916 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:49.210195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:49.210469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:49.219534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:49.221214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:49.233119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1229/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:16:53.338046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:53.338557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:53.338557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:53.358288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:16:53.359493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:16:53.368099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1198/2427] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Jul 5 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:16:53.390992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:16:53.402893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88963e35-f0dc-40a9-8090-1d5c18ab6379 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:16:53.409932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:16:53.410586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:16:53.410869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:16:53.411144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:16:53.420120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:16:53.421763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:16:53.431755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1230/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:17:03.352224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=42 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:03.427155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=36 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:26.915197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:26.916748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:26.929870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd97a-d03d-4f4c-b346-e9e138dc44eb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:26.935925 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:26.936855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:26.937141 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:26.937413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] PATH_INFO: `/v3/users/ad37425a73ae44f2a4c0182267345b58` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:26.938698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad37425a73ae44f2a4c0182267345b58)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:26.940706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:26.987140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad37425a73ae44f2a4c0182267345b58'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:26.987789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad37425a73ae44f2a4c0182267345b58'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:26.988388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad37425a73ae44f2a4c0182267345b58'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:26.995229 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad37425a73ae44f2a4c0182267345b58'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.003692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6b0ff38c-98fb-4591-b101-4ab0e8bbaf03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad37425a73ae44f2a4c0182267345b58'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.021117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1199/2429] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:17:26 2022] DELETE /identity/v3/users/ad37425a73ae44f2a4c0182267345b58 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:17:27.201746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.212423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765240-51f5-426d-8379-1a23bf20e422 service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.282806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.283616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.283901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.284181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] PATH_INFO: `/v3/projects/8222c81f779645c687cf5c44e4e54fe4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.285439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8222c81f779645c687cf5c44e4e54fe4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.287367 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.335083 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8222c81f779645c687cf5c44e4e54fe4', 'request_id': 'req-a6008033-b010-4a0a-8878-211bf0de449c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.341290 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8222c81f779645c687cf5c44e4e54fe4', 'request_id': 'req-a6008033-b010-4a0a-8878-211bf0de449c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.347017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8222c81f779645c687cf5c44e4e54fe4', 'request_id': 'req-a6008033-b010-4a0a-8878-211bf0de449c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.361639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] The token cache is being invalidate because project 8222c81f779645c687cf5c44e4e54fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:17:27.361963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.362864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a6008033-b010-4a0a-8878-211bf0de449c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:27.364240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1231/2430] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:17:27 2022] DELETE /identity/v3/projects/8222c81f779645c687cf5c44e4e54fe4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:17:27.369607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.370709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.371230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.395074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:27.396299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:27.461196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1200/2431] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:17:27.470023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.470277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.470525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.490857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:27.492116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:27.500205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1232/2432] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:17:27.504603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.514649 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965aff-8098-4b91-bd08-6d780a570788 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.519405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.520069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.520349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.520659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.521413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:17:27.521716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.523512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.537233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1201/2433] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:17:27.541654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.551657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0aa20-690a-431f-9a2c-92720ff5e835 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.558040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.558721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.559071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.559291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.560002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.562356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.596254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1233/2434] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:17:27 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:17:27.598077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.608204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4e876-cf09-4587-8c5a-2fa8531a4907 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.667137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.667868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.668151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.668421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.669150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.671056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.677818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:27.696972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1202/2435] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:17:27 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:17:27.698224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.708760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b647417-775f-49b9-b15b-df81883dad4c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.713472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.714146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.714428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.714705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.715436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.717095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.731332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1234/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:17:27.732807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.743631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815117-6484-4a2c-bfff-6b0202937741 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.748767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.749442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.749771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.750041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.750777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.752377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d1166-a072-4ca9-ba13-25a03d7e83be admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.762723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1203/2437] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:17:27.767464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.778222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414aad-ce63-4ab1-9bcb-9d25c7e99f09 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:27.782962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:27.783848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.784133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.784414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] PATH_INFO: `/v3/projects/f3350dbfab954c5382a1aa8932c5c65a/users/123621ef7c2249aab885b02ada933342/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.799978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3350dbfab954c5382a1aa8932c5c65a, user_id=123621ef7c2249aab885b02ada933342, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:27.802634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:27.817860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1235/2438] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:17:27 2022] PUT /identity/v3/projects/f3350dbfab954c5382a1aa8932c5c65a/users/123621ef7c2249aab885b02ada933342/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:17:27.830323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25ef1-6148-4450-b2e1-be3cea75e2bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:27.830323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25ef1-6148-4450-b2e1-be3cea75e2bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:27.830591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25ef1-6148-4450-b2e1-be3cea75e2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:27.858732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e6a25ef1-6148-4450-b2e1-be3cea75e2bd None None] MFA Rules not processed for user `123621ef7c2249aab885b02ada933342`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:27.859911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6a25ef1-6148-4450-b2e1-be3cea75e2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:27.927193 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1204/2439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:17:27.938896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:27.940636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:27.974671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:28.023665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46974-9440-45f2-9631-45cfd9c1b0d2 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:28.027785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:28.028435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:28.028745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:28.029022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:28.037972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:28.039466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:28.048890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1236/2440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:17:30.380403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d65f-5381-429f-8c7c-1c453b055ca8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:30.380981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d65f-5381-429f-8c7c-1c453b055ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:30.380981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d65f-5381-429f-8c7c-1c453b055ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:30.399395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1286d65f-5381-429f-8c7c-1c453b055ca8 None None] MFA Rules not processed for user `9ea320dbf059485c9468a0e033b39d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:30.400703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1286d65f-5381-429f-8c7c-1c453b055ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:30.462174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1205/2441] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:17:38.044643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=23 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:38.324359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:38.389360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fea48-06f6-4a6d-bd3a-ae4c52417060 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:38.394450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:38.395322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:38.395616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:38.395841 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] PATH_INFO: `/v3/users/123621ef7c2249aab885b02ada933342` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:38.397129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] RBAC: Authorizing `identity:delete_user(user_id=123621ef7c2249aab885b02ada933342)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:38.399079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:38.447638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123621ef7c2249aab885b02ada933342'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:38.448289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123621ef7c2249aab885b02ada933342'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:38.448922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123621ef7c2249aab885b02ada933342'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:38.455668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123621ef7c2249aab885b02ada933342'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:38.463946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123621ef7c2249aab885b02ada933342'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:38.482677 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1237/2442] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:17:38 2022] DELETE /identity/v3/users/123621ef7c2249aab885b02ada933342 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:17:38.487329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:38.487851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:38.487851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:38.506152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:38.507361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:38.583162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1206/2443] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:17:38.591865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:38.593474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:38.654080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57e844-5606-40dc-be00-606d23c2988f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:38.658046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:38.658693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:38.658970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:38.659246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:38.668204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:38.669803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:38.679589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1238/2444] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:17:39.159541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:39.161237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:39.174789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b48b6-6c61-465a-aba3-19a25f52561d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:39.181904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:39.183100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:39.183456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:39.183732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] PATH_INFO: `/v3/projects/f3350dbfab954c5382a1aa8932c5c65a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:39.185443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3350dbfab954c5382a1aa8932c5c65a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:39.187510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:39.199912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:39.247956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3350dbfab954c5382a1aa8932c5c65a', 'request_id': 'req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:39.254451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3350dbfab954c5382a1aa8932c5c65a', 'request_id': 'req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:39.265074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3350dbfab954c5382a1aa8932c5c65a', 'request_id': 'req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:39.281867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] The token cache is being invalidate because project f3350dbfab954c5382a1aa8932c5c65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:17:39.282540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:39.283386 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:17:39.285242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1207/2445] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:17:39 2022] DELETE /identity/v3/projects/f3350dbfab954c5382a1aa8932c5c65a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:17:43.048768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:43.050309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:43.079378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:43.113972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cea5e0-b0d1-4932-b488-c15a745d7c54 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:43.163861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:43.164414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:43.164725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:43.165000 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:43.166977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:43.238856 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:43.240287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d221dbc-004f-4fd1-bf1d-a62744f15007 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:43.251147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1239/2446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:17:45.919865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:45.922178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:46.002348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a979f-8d36-4da9-ab63-1b71f4dd731f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:46.006261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:46.006912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:46.007192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:46.007469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:46.009401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:46.024333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:46.025951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:46.038629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1208/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:17:51.602886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:51.603443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:51.603443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:51.621661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] MFA Rules not processed for user `bb218ceeb8eb4955850daa843fe03add`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:17:51.622879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:51.679294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1240/2448] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:17:53.396289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:17:53.398415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:53.414636 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5922c58-96ca-4456-9f6e-e9db38a58361 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:17:53.421973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:17:53.422657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:17:53.422940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:17:53.423215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:17:53.425718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:17:53.439693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:17:53.441345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:17:53.450947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1209/2449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:17:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:01.671981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:03.446420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:30.344065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:30.345698 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:30.358872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753bc0a-b859-422d-b380-86f5025c07b3 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:30.363399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:30.364045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:30.364330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:30.364631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:30.366731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:30.427664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:30.429173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644e64-dc63-4e7c-9eca-139894b8bab6 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:30.439263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1241/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:33.780231 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:33.781870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:33.797087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644a2f-7979-405f-9922-e87cc26480f2 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:33.803701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:33.804429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:33.804947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:33.805224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:33.807101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:33.821878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:33.823628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:33.837422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1210/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:36.640515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:36.641055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:36.641055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:36.664235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] MFA Rules not processed for user `d49798cb46a84cc8abad89604ec784f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:18:36.666114 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:36.678327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1242/2452] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:18:37.004979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:37.015287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96370-72a3-48be-93e8-4bfac8ba82d3 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:37.019321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:37.019960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:37.020234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:37.020528 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:37.022466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:37.032997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:37.034442 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:37.042938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1211/2453] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:37.386364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:37.387873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:37.461873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a959f-0cf2-4a7b-aa10-ec88a1e5967a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:37.466640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:37.467299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:37.467582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:37.467846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:37.469645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:37.481279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:37.482893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:37.493747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1243/2454] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:39.985513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:39.995006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34323b11-9055-4c28-a4dc-ab25b0e15efe service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:39.999690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:40.000397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:40.000718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:40.000998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:40.003078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:40.013871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:40.015313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:40.023312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1212/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:40.072917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:40.082705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489d5-1e3e-440d-b680-5458b0bb2a40 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:40.087317 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:40.087980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:40.088324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:40.088689 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:40.091661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:40.160125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:40.161630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:40.171623 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1244/2456] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:18:50.019993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=18 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:50.167164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:50.402725 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:18:50.420924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1023d-029e-4d48-be3f-222919627a38 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:18:50.426846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:18:50.427724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:18:50.428010 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:18:50.428637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:18:50.430594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:18:50.446591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:18:50.448389 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:18:50.461254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1213/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:00.455801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:01.065510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:01.075701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db956fe-aa7b-4ae5-886c-7f0302dd8344 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:01.080487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:01.081220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:01.081573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:01.081839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:01.084086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:01.153122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:01.154600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:01.164130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1245/2458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:04.504670 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:04.506172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:04.520984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b8e0-ee22-4996-bfc8-276565aed5df service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:04.526496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:04.527404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:04.527685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:04.527956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] PATH_INFO: `/v3/users/9ea320dbf059485c9468a0e033b39d90` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:04.529292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea320dbf059485c9468a0e033b39d90)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:04.531167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:04.581735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea320dbf059485c9468a0e033b39d90'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.582488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea320dbf059485c9468a0e033b39d90'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.583183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea320dbf059485c9468a0e033b39d90'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.590876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea320dbf059485c9468a0e033b39d90'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.598553 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a6f48d7-7af9-4e83-bf33-471332cda225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea320dbf059485c9468a0e033b39d90'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.616312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1214/2459] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:04 2022] DELETE /identity/v3/users/9ea320dbf059485c9468a0e033b39d90 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:04.791373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:04.801806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb382-4531-4401-9c0d-318ad76dca93 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:04.861614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:04.862485 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:04.862769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:04.863042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] PATH_INFO: `/v3/projects/b2ebe17e7f8841c4acc848b955f230c6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:04.864245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ebe17e7f8841c4acc848b955f230c6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:04.866210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:04.913548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ebe17e7f8841c4acc848b955f230c6', 'request_id': 'req-e5a31f63-0bdb-4796-9bbb-7b6772022e52'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.919517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ebe17e7f8841c4acc848b955f230c6', 'request_id': 'req-e5a31f63-0bdb-4796-9bbb-7b6772022e52'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.925075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ebe17e7f8841c4acc848b955f230c6', 'request_id': 'req-e5a31f63-0bdb-4796-9bbb-7b6772022e52'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.939118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] The token cache is being invalidate because project b2ebe17e7f8841c4acc848b955f230c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:04.939429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.940040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e5a31f63-0bdb-4796-9bbb-7b6772022e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:04.941625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1246/2460] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:04 2022] DELETE /identity/v3/projects/b2ebe17e7f8841c4acc848b955f230c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:04.946830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:04.947121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:04.947403 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:04.966015 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:04.967273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:05.028130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1215/2461] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:05.036166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.036366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.036700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.056692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:05.058239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:05.067838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1247/2462] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:05.072486 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.087798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae9af-b918-47d3-b354-92f14f15ba65 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.093363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.094026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.094311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.094590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.095305 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:05.095615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.097416 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.109533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1216/2463] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:05.114237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.123830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522636a-35af-4b24-b22d-d76863a61583 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.129868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.130527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.130806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.131079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.131779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.133717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.147886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:05.174121 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1248/2464] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:05 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:05.178300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.188970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ab69-def5-4f94-9755-d0bdbe0e4604 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.245044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.245712 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.245988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.246263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.246943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.248899 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.255535 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:05.272131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1217/2465] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:05.276298 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.286745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a6f0-0e58-453a-8ae3-1e3ecb58b753 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.291617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.292269 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.292591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.292868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.293593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.295195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.305110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1249/2466] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:05.309480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.320099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1a8e-472b-49fd-a392-195fff97d712 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.326102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.326768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.327050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.327322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.328049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.329685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a46a3d-f06e-4180-8f2c-0e6b63e872a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.341248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1218/2467] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:05.345546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.356050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9010f-d547-4666-a786-ac80b62a931c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.361890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.362787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.363062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.363347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] PATH_INFO: `/v3/projects/8e3f7e41719e4507ab5f6a5ec1a91027/users/768f289443374dfc857b8508584ea626/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.378929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3f7e41719e4507ab5f6a5ec1a91027, user_id=768f289443374dfc857b8508584ea626, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.381620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.401129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1250/2468] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:05 2022] PUT /identity/v3/projects/8e3f7e41719e4507ab5f6a5ec1a91027/users/768f289443374dfc857b8508584ea626/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:05.412495 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8199-eb86-4456-8414-888e66902301 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.412820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8199-eb86-4456-8414-888e66902301 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.413098 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8199-eb86-4456-8414-888e66902301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.441114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-982e8199-eb86-4456-8414-888e66902301 None None] MFA Rules not processed for user `768f289443374dfc857b8508584ea626`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:05.442348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-982e8199-eb86-4456-8414-888e66902301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:05.515144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1219/2469] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:05.527201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:05.530161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:05.610532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a8b74-a846-41ae-bee1-bdd425ea33b5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:05.617789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:05.618475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:05.618753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:05.619050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:05.628903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:05.630516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995acca-33a9-4ba0-aeaa-48581a9349bd service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:05.639610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1251/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:19:10.885407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e8199-eb86-4456-8414-888e66902301 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:10.959016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e8199-eb86-4456-8414-888e66902301 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:10.965250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:10.966207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:10.966497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:10.966772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] PATH_INFO: `/v3/users/768f289443374dfc857b8508584ea626` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:10.968008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] RBAC: Authorizing `identity:delete_user(user_id=768f289443374dfc857b8508584ea626)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:10.970085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.021550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768f289443374dfc857b8508584ea626'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.022215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768f289443374dfc857b8508584ea626'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.022918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768f289443374dfc857b8508584ea626'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.030502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768f289443374dfc857b8508584ea626'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.040013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768f289443374dfc857b8508584ea626'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.045732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:11.060668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1220/2471] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:10 2022] DELETE /identity/v3/users/768f289443374dfc857b8508584ea626 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:11.065254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.065729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.065821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.082910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:11.084088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:11.148155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1252/2472] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:11.158056 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.159674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:11.218584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320538c1-e738-4616-9040-adbcfc37588f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.222946 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.223581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.223861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.224130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.235552 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.237634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38230-00d7-439a-bdc4-647536955a22 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.250423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1221/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:11.526275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.527952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:11.540441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d92ae-bd8d-4a05-832e-b61bca086b5e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.546249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.547134 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.547396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.547682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] PATH_INFO: `/v3/projects/8e3f7e41719e4507ab5f6a5ec1a91027` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.548999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3f7e41719e4507ab5f6a5ec1a91027)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.551059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.589533 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:11.604183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3f7e41719e4507ab5f6a5ec1a91027', 'request_id': 'req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.610445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3f7e41719e4507ab5f6a5ec1a91027', 'request_id': 'req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.615830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3f7e41719e4507ab5f6a5ec1a91027', 'request_id': 'req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.629020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] The token cache is being invalidate because project 8e3f7e41719e4507ab5f6a5ec1a91027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:11.629304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.629938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2d8f0bd3-3f1c-4ac5-94a4-fbad73631971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:11.631503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1253/2474] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:11 2022] DELETE /identity/v3/projects/8e3f7e41719e4507ab5f6a5ec1a91027 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:11.636526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.636814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.637088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.656644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:11.657848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:11.721660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1222/2475] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:11.729802 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.730127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.730408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.749913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:11.751135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:11.760397 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1254/2476] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:11.765142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.780157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b077-a0ac-414a-93eb-dff28264bebc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.785337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.785994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.786279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.786558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.787285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:11.787595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.789281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.801317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1223/2477] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:11.805791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.816010 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9b18e-24f3-4994-a6f0-d1079eb0ded5 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.821013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.821680 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.821936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.822241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.822945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.824902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.852846 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1255/2478] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:11 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:11.857129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.867866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5a63-ee68-450d-8fd1-fa3d2d515c33 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.937893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.938538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.938827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.939100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.939969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.941938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.963012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1224/2479] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:11 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:11.967282 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:11.978239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5da6-4ed9-4698-8fe5-e47d92ce102a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:11.984136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:11.984847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:11.985129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:11.985404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:11.986139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:11.987756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:11.998864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1256/2480] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:12.002848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.013164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c5767-c24b-4448-98ff-b03a422fa644 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.018207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.018857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.019143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.019420 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.020145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.021765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5edbc0-4628-4f92-b059-9471064b03a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.023026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:12.034007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1225/2481] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:12.038450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.048547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8cde-2d61-4dad-88ae-4cfa6ee3fd01 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.053431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.054391 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.054668 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.054921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] PATH_INFO: `/v3/projects/948abde18bc7436483944f1d6abd2478/users/2ae517f275974dd8933b3930b8afc9a7/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.070267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=948abde18bc7436483944f1d6abd2478, user_id=2ae517f275974dd8933b3930b8afc9a7, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.072966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.088591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1257/2482] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:12 2022] PUT /identity/v3/projects/948abde18bc7436483944f1d6abd2478/users/2ae517f275974dd8933b3930b8afc9a7/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:12.099094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.099401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.099677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.126680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] MFA Rules not processed for user `2ae517f275974dd8933b3930b8afc9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:12.127852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:12.203012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1226/2483] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:19:12.207697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.273300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f44f-f9a5-439d-9978-e1b50bb0f97a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.279204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.279865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.280150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.280423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.281142 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.283068 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.310665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1258/2484] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:12 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:12.315087 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.326406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d671-9af6-4fd2-ad9c-6d0931e6a0c3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.385955 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.386547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.386830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.387099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.387800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.389837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.411370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1227/2485] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:12 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:12.415525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.425997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ae32-404f-4cf1-843d-f9d79fcd6b01 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.430976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.431613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.431891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.432164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.433275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.434911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.446199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1259/2486] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:12.450820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.465767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba2f1-54b1-4d4b-b2a5-f6b398b065b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.471858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.472787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.473065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.473338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] PATH_INFO: `/v3/projects/85bf06d3b43849b0af92ab6e857ae194/users/f30538d5e99744dd9645be09fa762731/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.489650 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf06d3b43849b0af92ab6e857ae194, user_id=f30538d5e99744dd9645be09fa762731, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.492370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.506928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1228/2487] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:12 2022] PUT /identity/v3/projects/85bf06d3b43849b0af92ab6e857ae194/users/f30538d5e99744dd9645be09fa762731/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:12.511065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.523901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59d70-edc0-4f88-8504-7c97bb35535a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.554730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:12.586687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.587357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.587643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.587923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.588712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.590345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7da342-13db-4fe5-9fbc-8280e40fe574 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.600855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1260/2488] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:12.605585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.617307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35420-45ef-45cf-aa89-7cb61f15af40 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.622927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.623816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.624099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.624381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] PATH_INFO: `/v3/projects/85bf06d3b43849b0af92ab6e857ae194/users/f30538d5e99744dd9645be09fa762731/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.626617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf06d3b43849b0af92ab6e857ae194, user_id=f30538d5e99744dd9645be09fa762731, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.629321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.641226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1229/2489] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:12 2022] PUT /identity/v3/projects/85bf06d3b43849b0af92ab6e857ae194/users/f30538d5e99744dd9645be09fa762731/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:12.653110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.653379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.653834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.680678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] MFA Rules not processed for user `f30538d5e99744dd9645be09fa762731`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:12.681897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:12.759918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1261/2490] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:12.771534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.773571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:12.819764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:12.837761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd11eb-46cc-47c8-9826-babb3c23f98c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.841879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.842557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.842837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.843107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:12.852829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:12.854300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:12.863754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1230/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:12.944827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:12.958374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66aaa-2cef-47cf-af6f-12e64e0ba8c1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:12.962571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:12.963204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:12.963479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:12.963751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:13.039117 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:13.041520 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24a5c-e0f0-4d5e-b331-01f15286779a service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:13.052297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1262/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:20.149183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:20.213014 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa6b08-cba1-4d30-ad7e-c9bdf15da8af service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:20.220863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:20.222095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:20.222327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:20.222682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] PATH_INFO: `/v3/users/2ae517f275974dd8933b3930b8afc9a7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:20.224643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae517f275974dd8933b3930b8afc9a7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:20.227729 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:20.275943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae517f275974dd8933b3930b8afc9a7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.276613 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae517f275974dd8933b3930b8afc9a7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.277199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae517f275974dd8933b3930b8afc9a7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.283922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae517f275974dd8933b3930b8afc9a7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.292132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae517f275974dd8933b3930b8afc9a7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.310768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1231/2493] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:20 2022] DELETE /identity/v3/users/2ae517f275974dd8933b3930b8afc9a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:20.315384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:20.315879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:20.315976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:20.332695 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:20.333906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:20.379185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:20.395951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1263/2494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:20.406199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:20.407914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:20.471605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d7cd-2451-4c5a-90c6-4466763bdbed admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:20.477204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:20.478073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:20.478523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:20.478839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:20.489432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:20.490889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:20.500418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1232/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:20.773604 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:20.775128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:20.790021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814482-3976-4cc9-9077-4fbdd18c6222 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:20.795528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:20.796411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:20.796717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:20.796989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] PATH_INFO: `/v3/projects/948abde18bc7436483944f1d6abd2478` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:20.798735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=948abde18bc7436483944f1d6abd2478)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:20.801018 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:20.857590 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948abde18bc7436483944f1d6abd2478', 'request_id': 'req-ef244e60-6cb9-4248-81de-57c5dd06f10c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.864095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948abde18bc7436483944f1d6abd2478', 'request_id': 'req-ef244e60-6cb9-4248-81de-57c5dd06f10c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.869798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948abde18bc7436483944f1d6abd2478', 'request_id': 'req-ef244e60-6cb9-4248-81de-57c5dd06f10c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.883608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] The token cache is being invalidate because project 948abde18bc7436483944f1d6abd2478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:20.884036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.884694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:20.886384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1264/2496] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:20 2022] DELETE /identity/v3/projects/948abde18bc7436483944f1d6abd2478 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:20.890620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:20.895666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:20.901030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411841a-321d-4cef-a507-b689c02c3d72 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:20.964928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:20.965882 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:20.966166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:20.966460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] PATH_INFO: `/v3/users/f30538d5e99744dd9645be09fa762731` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:20.967691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30538d5e99744dd9645be09fa762731)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:20.969683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.017835 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30538d5e99744dd9645be09fa762731'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.018778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30538d5e99744dd9645be09fa762731'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.019388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30538d5e99744dd9645be09fa762731'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.026620 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30538d5e99744dd9645be09fa762731'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.033926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1b307686-d137-44d2-8a93-26607a1c2298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30538d5e99744dd9645be09fa762731'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.052022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1233/2497] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:20 2022] DELETE /identity/v3/users/f30538d5e99744dd9645be09fa762731 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:21.344764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.346332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:21.359636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244e60-6cb9-4248-81de-57c5dd06f10c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.416546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.417451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.417728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.418030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] PATH_INFO: `/v3/projects/85bf06d3b43849b0af92ab6e857ae194` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.419253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bf06d3b43849b0af92ab6e857ae194)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.421222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.471161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bf06d3b43849b0af92ab6e857ae194', 'request_id': 'req-074162d2-1e5a-43be-8486-1a8773efed6e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.477742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bf06d3b43849b0af92ab6e857ae194', 'request_id': 'req-074162d2-1e5a-43be-8486-1a8773efed6e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.483909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bf06d3b43849b0af92ab6e857ae194', 'request_id': 'req-074162d2-1e5a-43be-8486-1a8773efed6e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.497821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] The token cache is being invalidate because project 85bf06d3b43849b0af92ab6e857ae194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:21.498131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.498870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-074162d2-1e5a-43be-8486-1a8773efed6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:21.500509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1265/2498] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:21 2022] DELETE /identity/v3/projects/85bf06d3b43849b0af92ab6e857ae194 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:21.505746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.506205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.506404 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.525680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:21.526921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:21.585485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1234/2499] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:21.597177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.597465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.597741 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.605950 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:21.617556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:21.619499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:21.628173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1266/2500] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:21.637826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.648421 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf97d3f-b645-44ab-a976-24767ecd998d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.653394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.654059 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.654340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.654611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.655338 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:21.655640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.657300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.669984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1235/2501] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:21.674751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.684546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3a68a-1683-4530-a65b-8c98d2824811 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.689987 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.690642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.690920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.691200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.691897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.693852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.720009 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1267/2502] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:21 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:21.724207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.734746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4a14-a003-42c8-8be7-3ccac5077917 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.740597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:21.795986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.796710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.796984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.797259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.797950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.800017 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.820907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1236/2503] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:21 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:21.824939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.836125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dadb0-63be-4db7-a0e1-6ea426a863db admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.841571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.842277 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.842557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.842833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.843564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.845247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.856691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1268/2504] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:21.862476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.873197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67437f-257d-448e-b0c7-74a3b5c1bc50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.879574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.880241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.880559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.880837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.881567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.883175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1c401-b148-4899-9397-6c5dd564f7e9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.893800 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1237/2505] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:21.898455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:21.909495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57a5-1796-44e3-9e92-413f24b55b7e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:21.915263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:21.916127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.916409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.916721 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] PATH_INFO: `/v3/projects/aa261a51be3849e4830a30ea5d230521/users/d131edfeb3fb450ba456d49a83182502/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.933022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa261a51be3849e4830a30ea5d230521, user_id=d131edfeb3fb450ba456d49a83182502, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:21.935674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:21.951388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1269/2506] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:21 2022] PUT /identity/v3/projects/aa261a51be3849e4830a30ea5d230521/users/d131edfeb3fb450ba456d49a83182502/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:19:21.963037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:21.963328 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:21.963605 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:21.991323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] MFA Rules not processed for user `d131edfeb3fb450ba456d49a83182502`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:21.993238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:22.066795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1238/2507] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:22.071344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.137345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340631-8c7a-4497-b9e9-7df773b8878e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.142832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.143530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.143842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.144113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.144897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.147015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.178460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1270/2508] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:22 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:22.183145 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.198795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcc269-fa13-4e99-baa4-724bc1e6143f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.260067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.260807 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.261114 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.261394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.262102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.264091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.290086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1239/2509] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:22 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:22.291331 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.301725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b1d5-18ea-42c7-83d2-d2f9e2bc9ed9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.306764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.307815 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.308092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.308379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.309124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.310701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.322062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1271/2510] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:19:22.326556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.337097 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7f1ff-17ef-40f4-b484-8131b46a1a19 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.341820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.342706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.342989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.343264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] PATH_INFO: `/v3/projects/5c6d9710d880467386fac221263a45dd/users/6c2f05b3fabf4550af6e32f3c8648eb9/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.345719 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:22.359843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d9710d880467386fac221263a45dd, user_id=6c2f05b3fabf4550af6e32f3c8648eb9, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.362524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.375792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1240/2511] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:22 2022] PUT /identity/v3/projects/5c6d9710d880467386fac221263a45dd/users/6c2f05b3fabf4550af6e32f3c8648eb9/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:19:22.380096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.392258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9253-b327-4f1e-99cf-a580d43b48c4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.454452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.455132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.455413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.455645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.456407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.458048 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e66f-b584-4c38-b482-a062e16f12fd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.468651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1272/2512] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:22.473049 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.484401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8543f-635a-4c61-8af4-01cb77e8d2c7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.489996 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.490908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.491212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.491480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] PATH_INFO: `/v3/projects/5c6d9710d880467386fac221263a45dd/users/6c2f05b3fabf4550af6e32f3c8648eb9/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.493523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d9710d880467386fac221263a45dd, user_id=6c2f05b3fabf4550af6e32f3c8648eb9, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.496208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.507507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1241/2513] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:22 2022] PUT /identity/v3/projects/5c6d9710d880467386fac221263a45dd/users/6c2f05b3fabf4550af6e32f3c8648eb9/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:22.518040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.518330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.518629 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.543233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:22.553592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] MFA Rules not processed for user `6c2f05b3fabf4550af6e32f3c8648eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:22.555870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:22.650228 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1273/2514] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:22.662057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:22.663989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:22.726700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19885d-c781-4f07-95cf-71c4bb1dded1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:22.730730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:22.731377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:22.731657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:22.731929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:22.789423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:22.790858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:22.801121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1242/2515] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:24.179817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:24.181332 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:24.194614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadbda8-3145-4d97-9fa4-2ac81c56a906 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:24.198584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:24.199226 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:24.199502 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:24.199775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:24.213612 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:24.215038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37174-e49a-466b-a384-5a5c460e2dd1 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:24.224756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1274/2516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:28.017644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:28.083009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39caa8-05cb-4af9-b877-721ba89530d5 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:28.093586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:28.093586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:28.093586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:28.093586 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] PATH_INFO: `/v3/users/d131edfeb3fb450ba456d49a83182502` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:28.093987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d131edfeb3fb450ba456d49a83182502)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:28.093987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:28.121796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:28.142562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd131edfeb3fb450ba456d49a83182502'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.143204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd131edfeb3fb450ba456d49a83182502'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.143793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd131edfeb3fb450ba456d49a83182502'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.150574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd131edfeb3fb450ba456d49a83182502'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.160796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd131edfeb3fb450ba456d49a83182502'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.179514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1243/2517] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:28 2022] DELETE /identity/v3/users/d131edfeb3fb450ba456d49a83182502 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:28.184731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:28.185241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:28.185241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:28.203697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:28.204961 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:28.269088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1275/2518] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:28.279069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:28.280688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:28.339467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d3a8-08e8-43f0-bbd6-51cbd4989d00 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:28.343509 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:28.344195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:28.344523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:28.344878 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:28.355130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:28.356679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:28.366742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1244/2519] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:28.644247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:28.645881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:28.663379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bbc47-97b8-41ee-acd2-0f9f3ee51ab6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:28.669158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:28.670022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:28.670356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:28.670636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] PATH_INFO: `/v3/projects/aa261a51be3849e4830a30ea5d230521` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:28.672093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa261a51be3849e4830a30ea5d230521)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:28.674281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:28.722747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa261a51be3849e4830a30ea5d230521', 'request_id': 'req-665d5475-e9bc-4742-bb87-e72632aa48dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.729195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa261a51be3849e4830a30ea5d230521', 'request_id': 'req-665d5475-e9bc-4742-bb87-e72632aa48dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.736700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa261a51be3849e4830a30ea5d230521', 'request_id': 'req-665d5475-e9bc-4742-bb87-e72632aa48dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.751261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] The token cache is being invalidate because project aa261a51be3849e4830a30ea5d230521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:28.751545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.752189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.753864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1276/2520] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:28 2022] DELETE /identity/v3/projects/aa261a51be3849e4830a30ea5d230521 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:28.758005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:28.767865 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df477d-81f2-45ec-9880-0008e8028909 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:28.830341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:28.831263 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:28.831547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:28.831824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] PATH_INFO: `/v3/users/6c2f05b3fabf4550af6e32f3c8648eb9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:28.833106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2f05b3fabf4550af6e32f3c8648eb9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:28.835078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:28.886740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2f05b3fabf4550af6e32f3c8648eb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.887397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2f05b3fabf4550af6e32f3c8648eb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.888011 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2f05b3fabf4550af6e32f3c8648eb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.889301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:28.895758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2f05b3fabf4550af6e32f3c8648eb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.904163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c3deab99-f3f9-4ff0-8965-55b78185b099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2f05b3fabf4550af6e32f3c8648eb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:28.921848 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1245/2521] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:28 2022] DELETE /identity/v3/users/6c2f05b3fabf4550af6e32f3c8648eb9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:29.267483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.269238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:29.287132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d5475-e9bc-4742-bb87-e72632aa48dc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.291801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:29.353628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.354515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.354801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.355056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] PATH_INFO: `/v3/projects/5c6d9710d880467386fac221263a45dd` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.356363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6d9710d880467386fac221263a45dd)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.358364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.407469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6d9710d880467386fac221263a45dd', 'request_id': 'req-17be758d-731a-48a2-9243-3950cae75d8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:29.413847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6d9710d880467386fac221263a45dd', 'request_id': 'req-17be758d-731a-48a2-9243-3950cae75d8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:29.419979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6d9710d880467386fac221263a45dd', 'request_id': 'req-17be758d-731a-48a2-9243-3950cae75d8e'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:29.433870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] The token cache is being invalidate because project 5c6d9710d880467386fac221263a45dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:29.434158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:29.434879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17be758d-731a-48a2-9243-3950cae75d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:29.436794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1277/2522] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:29 2022] DELETE /identity/v3/projects/5c6d9710d880467386fac221263a45dd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:29.441742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.442222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.442325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.460656 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:29.461860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:29.525896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1246/2523] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:29.533993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aad94-8429-43a1-af51-acd80317c98b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.534216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aad94-8429-43a1-af51-acd80317c98b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.534498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aad94-8429-43a1-af51-acd80317c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.553429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-917aad94-8429-43a1-af51-acd80317c98b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:29.554644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-917aad94-8429-43a1-af51-acd80317c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:29.564022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1278/2524] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:29.568355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.578506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3951f2-80ec-448f-b0ee-20e7faf65fd1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.583845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.584529 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.584810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.585082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.585834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:29.586129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.587737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.599929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1247/2525] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:29.604970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aad94-8429-43a1-af51-acd80317c98b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.619082 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aad94-8429-43a1-af51-acd80317c98b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.627210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.627867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.628263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.628694 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.629382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.631323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.661864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1279/2526] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:29 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:29.663152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.673604 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f029-b3d3-46af-9211-ae7c386c04f6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.734217 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.734890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.735170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.735439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.736172 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.738197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.759323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1248/2527] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:29 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:19:29.763500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.774138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cfba-6707-449f-9e17-ff65e0cc8ead admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.779328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.780025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.780307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.780636 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.781371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.783103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.795859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1280/2528] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:29.800067 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.811534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5fdb-71e2-477b-be6f-19aaa32121e2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.817783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.818434 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.818709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.818982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.819713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.821348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7dd82-a012-49d3-b6b1-65317fdd8586 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.831873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1249/2529] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:29.836067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:29.846569 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbffc9-a24b-4b25-ab95-55ae8e029ec7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:29.851582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:29.852471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.852769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.853043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] PATH_INFO: `/v3/projects/816818ab51bd468ab37e6b69c74bc6d5/users/6ca42437d9e8422d8681fa2f2e751303/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.868166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=816818ab51bd468ab37e6b69c74bc6d5, user_id=6ca42437d9e8422d8681fa2f2e751303, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:29.870943 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:29.886059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1281/2530] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:29 2022] PUT /identity/v3/projects/816818ab51bd468ab37e6b69c74bc6d5/users/6ca42437d9e8422d8681fa2f2e751303/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:29.897350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:29.897645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:29.897924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:29.926072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] MFA Rules not processed for user `6ca42437d9e8422d8681fa2f2e751303`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:29.927352 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:29.947777 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:29.999402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1250/2531] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:30.004263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.039942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:30.070376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff617-32cd-45a6-b9f8-853876865d3a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.076249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.076954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.077239 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.077543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.078267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.080288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.108385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1282/2532] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:30 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:30.112692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.123913 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316f4f-dd08-48fe-8a08-9796790a6b79 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.185335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.186008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.186292 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.186570 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.187250 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.189219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.210678 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1251/2533] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:30 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:30.214706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.225761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047adda-91a5-44f2-94ff-7cc844576ef8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.231376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.232045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.232329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.232648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.233384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.235008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.246666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1283/2534] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:30.250994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.261366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0977d-5f93-4b7c-a471-014b463d1410 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.267400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.268321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.268641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.268917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] PATH_INFO: `/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da/users/44d4db299ec04b6698d00d283b532d4c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.285147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e099cdb9d62f4667be1af8f3ae7b77da, user_id=44d4db299ec04b6698d00d283b532d4c, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.287892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.303324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1252/2535] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:30 2022] PUT /identity/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da/users/44d4db299ec04b6698d00d283b532d4c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:30.307614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.318120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad94b2-7a81-4b46-800c-113f7c6f7be7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.376886 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.377582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.377861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.378122 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.378875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.380534 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9d319-771f-43fe-81f2-782a7951e5cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.390895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1284/2536] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:30.395220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.406052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97092d-e479-4286-b7f0-605b19fef503 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.410933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.411829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.412117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.412392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] PATH_INFO: `/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da/users/44d4db299ec04b6698d00d283b532d4c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.414432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e099cdb9d62f4667be1af8f3ae7b77da, user_id=44d4db299ec04b6698d00d283b532d4c, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.417123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.427861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1253/2537] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:30 2022] PUT /identity/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da/users/44d4db299ec04b6698d00d283b532d4c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:30.439173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.439451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.439749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.467260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] MFA Rules not processed for user `44d4db299ec04b6698d00d283b532d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:30.468547 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:30.538445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1285/2538] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:30.555602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.559083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:30.621170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988082d-755a-462f-b3c3-173321afb82f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.625854 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.626606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.626884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.627156 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.637590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.639046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.648941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1254/2539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:30.748381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:30.758792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917be1-59fb-4397-b312-d91670d0c993 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:30.762839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:30.763481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:30.763760 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:30.764028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:30.792535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:30.833075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:30.834430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d8b9e-fa31-488b-b82b-973c88c5b32e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:30.844137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1286/2540] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:33.428718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:33.448573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:33.506069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315b895-98f6-4e16-b3da-03082d066e98 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:33.511326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:33.512219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:33.512595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:33.512876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] PATH_INFO: `/v3/users/6ca42437d9e8422d8681fa2f2e751303` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:33.514185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca42437d9e8422d8681fa2f2e751303)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:33.516132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:33.565261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca42437d9e8422d8681fa2f2e751303'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:33.565921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca42437d9e8422d8681fa2f2e751303'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:33.566508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca42437d9e8422d8681fa2f2e751303'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:33.573566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca42437d9e8422d8681fa2f2e751303'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:33.582009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca42437d9e8422d8681fa2f2e751303'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:33.599396 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1255/2541] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:33 2022] DELETE /identity/v3/users/6ca42437d9e8422d8681fa2f2e751303 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:33.604193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:33.604724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:33.604809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:33.623097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:33.624327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:33.688306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1287/2542] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:33.698160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:33.699830 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:33.768892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110589c-12ac-4792-970a-4509ea34b1fc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:33.773573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:33.774230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:33.774513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:33.774793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:33.784867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:33.786348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:33.796040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1256/2543] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:34.131225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:34.132775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:34.146106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a86f1-bed2-483e-b23a-ac9814655a41 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:34.152830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:34.153925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:34.154232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:34.154508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] PATH_INFO: `/v3/projects/816818ab51bd468ab37e6b69c74bc6d5` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:34.156294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816818ab51bd468ab37e6b69c74bc6d5)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:34.158510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:34.208275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816818ab51bd468ab37e6b69c74bc6d5', 'request_id': 'req-a682c2d4-e01c-42af-a521-788adcbe8920'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.214254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816818ab51bd468ab37e6b69c74bc6d5', 'request_id': 'req-a682c2d4-e01c-42af-a521-788adcbe8920'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.220030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816818ab51bd468ab37e6b69c74bc6d5', 'request_id': 'req-a682c2d4-e01c-42af-a521-788adcbe8920'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.234195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] The token cache is being invalidate because project 816818ab51bd468ab37e6b69c74bc6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:34.234479 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.235168 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.236830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1288/2544] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:34 2022] DELETE /identity/v3/projects/816818ab51bd468ab37e6b69c74bc6d5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:34.240988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:34.250903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c8c9-f1ee-4ebf-81e8-b594e2301d19 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:34.288990 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:34.314914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:34.315916 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:34.316260 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:34.316639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] PATH_INFO: `/v3/users/44d4db299ec04b6698d00d283b532d4c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:34.317972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d4db299ec04b6698d00d283b532d4c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:34.319977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:34.375577 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d4db299ec04b6698d00d283b532d4c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.376315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d4db299ec04b6698d00d283b532d4c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.376965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d4db299ec04b6698d00d283b532d4c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.384091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d4db299ec04b6698d00d283b532d4c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.393064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b206b12-a584-448b-b84c-6902cadb9961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d4db299ec04b6698d00d283b532d4c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.411742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1257/2545] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:34 2022] DELETE /identity/v3/users/44d4db299ec04b6698d00d283b532d4c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:34.689190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:34.690717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:34.707894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682c2d4-e01c-42af-a521-788adcbe8920 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:34.757796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:34.769620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:34.770526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:34.770804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:34.771079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] PATH_INFO: `/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:34.772399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e099cdb9d62f4667be1af8f3ae7b77da)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:34.774365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:34.822481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e099cdb9d62f4667be1af8f3ae7b77da', 'request_id': 'req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.828648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e099cdb9d62f4667be1af8f3ae7b77da', 'request_id': 'req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.836731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e099cdb9d62f4667be1af8f3ae7b77da', 'request_id': 'req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.851245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] The token cache is being invalidate because project e099cdb9d62f4667be1af8f3ae7b77da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:34.851530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.852185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-17c0c7ec-b3ce-4371-bc36-c30f33586cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:34.853823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1289/2546] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:34 2022] DELETE /identity/v3/projects/e099cdb9d62f4667be1af8f3ae7b77da => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:34.858979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:34.859462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:34.859573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:34.878884 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:34.880116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:34.941820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1258/2547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:34.949879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:34.950169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:34.950442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:34.969627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:34.970850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:34.980281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1290/2548] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:34.984731 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:34.994817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51122fef-ae4e-45a7-ac5f-7cde0749a94b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:34.999997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.000764 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.001048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.001290 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.002034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:35.002340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.003952 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.016494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1259/2549] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:35.020884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.030497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e860-4552-4d35-b0fb-dd183f5d0559 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.035892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.036579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.036862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.037253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.037936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.039852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.067507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1291/2550] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:35.071588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.082375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5f871-bcdb-4118-8312-cb499f3f9da6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.126184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:35.142892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.143601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.143877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.144132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.144856 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.146893 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.171627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1260/2551] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:35.172896 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.183826 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773d173-ef5b-49be-8b5d-1935eb8542f3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.188877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.189580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.189865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.190141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.190877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.192529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.204136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1292/2552] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:19:35.208204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.219064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba462-e10d-4ce6-a90c-e0dfa48cf211 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.225932 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.226995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.227584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.227994 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.228771 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.230441 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699058-7149-4c07-905c-555fd3e9e0b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.241170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1261/2553] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:35.245535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.255979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9872bf3-5158-4c92-8f22-2ce1d928b673 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.260755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.261642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.261924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.262224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] PATH_INFO: `/v3/projects/ed9283cc98374cf699058542c3d17e4e/users/a72f55afcf07475e944b1e2f187e4b7e/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.277045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9283cc98374cf699058542c3d17e4e, user_id=a72f55afcf07475e944b1e2f187e4b7e, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.279634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.294664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1293/2554] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:35 2022] PUT /identity/v3/projects/ed9283cc98374cf699058542c3d17e4e/users/a72f55afcf07475e944b1e2f187e4b7e/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:35.307556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.307843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.308119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.336681 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] MFA Rules not processed for user `a72f55afcf07475e944b1e2f187e4b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:35.338020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:35.403683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1262/2555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:35.408734 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.482654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b828-17dd-4ce7-822d-1d3ad107906b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.488910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.489631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.489927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.490204 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.490898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.492930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.520807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1294/2556] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:35.525212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.537216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2f342-373a-4503-96dd-bcb30841d0ba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.594914 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.595635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.595920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.596196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.596917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.598907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.620951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1263/2557] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:35.624969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.631017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:35.636769 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f20b0-5db9-4b57-bf50-95b8a6500e38 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.642974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.643664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.643974 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.644257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.645201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.647490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.658635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1295/2558] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:35.662942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.673804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044159-a699-4bdd-b6a9-5bb1473f39e9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.679814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.680737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.681021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.681299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] PATH_INFO: `/v3/projects/925252a072124182bb70432c31e9f7d4/users/38ad58f177ed4a04a46219b8ac62c55e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.698457 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925252a072124182bb70432c31e9f7d4, user_id=38ad58f177ed4a04a46219b8ac62c55e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.701194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.717219 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1264/2559] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:35 2022] PUT /identity/v3/projects/925252a072124182bb70432c31e9f7d4/users/38ad58f177ed4a04a46219b8ac62c55e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:35.721407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.731724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2d69-35e7-414b-9368-e58661cfe791 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.788750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.789334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.789613 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.789892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.790617 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.792215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e884b8-002f-4df6-877c-668a97243fd7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.802017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1296/2560] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:35.806862 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.818560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c12a72-b350-480b-b603-6d00eb7b69a7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:35.824415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:35.825340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.825626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.825904 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] PATH_INFO: `/v3/projects/925252a072124182bb70432c31e9f7d4/users/38ad58f177ed4a04a46219b8ac62c55e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.828074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925252a072124182bb70432c31e9f7d4, user_id=38ad58f177ed4a04a46219b8ac62c55e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:35.830776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:35.841540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1265/2561] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:35 2022] PUT /identity/v3/projects/925252a072124182bb70432c31e9f7d4/users/38ad58f177ed4a04a46219b8ac62c55e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:35.851652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:35.851938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:35.852210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:35.878384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] MFA Rules not processed for user `38ad58f177ed4a04a46219b8ac62c55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:35.879591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:35.952460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1297/2562] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:35.964055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:35.965908 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:35.972730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:36.024072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e72e-9043-471b-9ffa-371d64855bc9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:36.028037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:36.028717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:36.029000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:36.029277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:36.038639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:36.040166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:36.049943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1266/2563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:36.128255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:36.139175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371efb-a57a-47b4-b5a1-968630797d21 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:36.143243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:36.143891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:36.144174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:36.144464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:36.206436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:36.207882 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747959c3-4c2f-4102-be0b-fe25bfb7ab80 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:36.217232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1298/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:41.008301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:41.072031 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef30840-e02b-4650-9478-ede93245e4e6 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:41.077220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:41.078245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:41.078619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:41.078992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] PATH_INFO: `/v3/users/a72f55afcf07475e944b1e2f187e4b7e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:41.080380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72f55afcf07475e944b1e2f187e4b7e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:41.082372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:41.134564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72f55afcf07475e944b1e2f187e4b7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.135227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72f55afcf07475e944b1e2f187e4b7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.136411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72f55afcf07475e944b1e2f187e4b7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.144100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72f55afcf07475e944b1e2f187e4b7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.153221 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72f55afcf07475e944b1e2f187e4b7e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.171201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1267/2565] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:41 2022] DELETE /identity/v3/users/a72f55afcf07475e944b1e2f187e4b7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:41.175641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:41.176162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:41.176312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:41.194023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:41.195442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:41.200918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:41.271530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1299/2566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:41.281512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:41.283166 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:41.318500 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:41.351538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b05d57-ef80-4a7a-b964-f1e3e41fae63 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:41.355747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:41.356411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:41.356761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:41.357042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:41.366821 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:41.368307 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:41.378315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1268/2567] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:41.663776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:41.665607 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:41.679174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d4cdc-2e95-40f3-ab3c-a78019e365bb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:41.685766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:41.686738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:41.687085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:41.687429 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] PATH_INFO: `/v3/projects/ed9283cc98374cf699058542c3d17e4e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:41.688951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9283cc98374cf699058542c3d17e4e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:41.691624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:41.740473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9283cc98374cf699058542c3d17e4e', 'request_id': 'req-98205528-9697-432a-9f04-0d48cdd07652'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.746670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9283cc98374cf699058542c3d17e4e', 'request_id': 'req-98205528-9697-432a-9f04-0d48cdd07652'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.752388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9283cc98374cf699058542c3d17e4e', 'request_id': 'req-98205528-9697-432a-9f04-0d48cdd07652'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.765303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] The token cache is being invalidate because project ed9283cc98374cf699058542c3d17e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:41.765586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.766212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.767780 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1300/2568] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:41 2022] DELETE /identity/v3/projects/ed9283cc98374cf699058542c3d17e4e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:41.771870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:41.781524 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bfc8-07e1-4db6-a5a1-c70bf3b19ed3 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:41.841140 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:41.841992 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:41.842289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:41.842568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] PATH_INFO: `/v3/users/38ad58f177ed4a04a46219b8ac62c55e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:41.843783 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ad58f177ed4a04a46219b8ac62c55e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:41.845733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:41.892121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ad58f177ed4a04a46219b8ac62c55e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.892726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ad58f177ed4a04a46219b8ac62c55e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.893370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ad58f177ed4a04a46219b8ac62c55e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.900738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ad58f177ed4a04a46219b8ac62c55e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.911285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5dcd0a7c-a631-47cc-9f60-21c0c73bc71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ad58f177ed4a04a46219b8ac62c55e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:41.932066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1269/2569] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:41 2022] DELETE /identity/v3/users/38ad58f177ed4a04a46219b8ac62c55e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:42.216398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.217966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:42.233035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205528-9697-432a-9f04-0d48cdd07652 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.297553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.298427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.298708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.299013 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] PATH_INFO: `/v3/projects/925252a072124182bb70432c31e9f7d4` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.300188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] RBAC: Authorizing `identity:delete_project(project_id=925252a072124182bb70432c31e9f7d4)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.302136 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.343259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:42.354103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925252a072124182bb70432c31e9f7d4', 'request_id': 'req-d52dc190-efcb-4f66-bb34-af5f4d0edbce'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:42.360655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925252a072124182bb70432c31e9f7d4', 'request_id': 'req-d52dc190-efcb-4f66-bb34-af5f4d0edbce'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:42.367869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925252a072124182bb70432c31e9f7d4', 'request_id': 'req-d52dc190-efcb-4f66-bb34-af5f4d0edbce'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:42.382002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] The token cache is being invalidate because project 925252a072124182bb70432c31e9f7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:42.382493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:42.383183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d52dc190-efcb-4f66-bb34-af5f4d0edbce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:42.388191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1301/2570] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:42 2022] DELETE /identity/v3/projects/925252a072124182bb70432c31e9f7d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:42.389984 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.390892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.391181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.410323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:42.411634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:42.457781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:42.475738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1270/2571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:19:42.484915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.485202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.485496 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.505077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:42.506294 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:42.515305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1302/2572] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:42.519702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.529789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247abf69-179c-4359-9478-eab2ecf1f5ed None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.535007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.535660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.535944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.536224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.536983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:42.537299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.538912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.550763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1271/2573] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:19:42.554960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.564436 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f950cf5-c627-4e4a-bc11-7a900dbd44a2 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.569652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.570302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.570585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.570857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.571555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.573509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.602029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1303/2574] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:42 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:19:42.606235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.616564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e900-4baa-404d-adfb-3fef82a098ed admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.674198 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.674871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.675115 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.675398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.676095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.678133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.705275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1272/2575] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:42 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:42.706806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.717501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ca067-5a7c-4fe5-918a-5201db1d3e95 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.722205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.722898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.723175 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.723448 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.724173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.725808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.737060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1304/2576] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:42.741285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.751696 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ed06-67c9-47da-9cc1-8d0d6915db24 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.756788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.757466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.757750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.758028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.758768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.760510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30921d-1e1b-44ce-8833-49d8b9b144ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.770989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1273/2577] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:42.775305 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:42.785675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949667-7c18-40c1-9ba0-412aec78db3a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:42.790442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:42.791335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.791621 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.791900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] PATH_INFO: `/v3/projects/32c8fd8129994055942b264c6c34340e/users/7d096a24e11448f1b3be65e2457e3cee/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.807220 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c8fd8129994055942b264c6c34340e, user_id=7d096a24e11448f1b3be65e2457e3cee, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:42.809952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:42.825389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1305/2578] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:42 2022] PUT /identity/v3/projects/32c8fd8129994055942b264c6c34340e/users/7d096a24e11448f1b3be65e2457e3cee/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:42.894769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b7d-f9d5-4170-8512-857b1952faa8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:42.895070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b7d-f9d5-4170-8512-857b1952faa8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:42.895355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b7d-f9d5-4170-8512-857b1952faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:42.923857 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8c9f1b7d-f9d5-4170-8512-857b1952faa8 None None] MFA Rules not processed for user `7d096a24e11448f1b3be65e2457e3cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:42.925261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8c9f1b7d-f9d5-4170-8512-857b1952faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:42.992961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1274/2579] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:43.004656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:43.006524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:43.071253 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470752f-ddbc-4062-b5b0-41fe165848ff admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:43.075184 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:43.075844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:43.076131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:43.076409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:43.085325 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:43.086789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:43.096222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1306/2580] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:45.981149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:45.981648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:45.981761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:45.999267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:46.000494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:46.040940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:46.063070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1275/2581] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:19:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:46.112026 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:46.113509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:46.182270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f63c0-a551-4a02-8187-09df2f3c718e service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:46.189281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:46.190213 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:46.190571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:46.190951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:46.196816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:46.201544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:46.203276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc94a75-05b6-47a9-983f-4b2f60c88a0d service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:46.213128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1307/2582] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:19:56.054467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=5 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:56.211066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:58.010714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.080183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28e31c-e141-4a27-9bcb-725b579c3b5d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:58.085163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:58.085978 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.086261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.086539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] PATH_INFO: `/v3/users/7d096a24e11448f1b3be65e2457e3cee` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.087754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d096a24e11448f1b3be65e2457e3cee)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:58.089747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:58.137526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d096a24e11448f1b3be65e2457e3cee'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.138192 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d096a24e11448f1b3be65e2457e3cee'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.138809 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d096a24e11448f1b3be65e2457e3cee'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.145724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d096a24e11448f1b3be65e2457e3cee'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.153776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d096a24e11448f1b3be65e2457e3cee'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.173859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1276/2583] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:58 2022] DELETE /identity/v3/users/7d096a24e11448f1b3be65e2457e3cee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:58.178719 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.179223 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.179326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.197750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:58.198952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:58.261476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1308/2584] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:19:58.271499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.273108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:58.333517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226575-53d2-48fb-a884-05e7f099aa10 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:58.337418 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:58.338151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.338301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.338537 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.349066 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:58.351459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9701ca-18f7-4c0a-8267-932a46783848 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:58.362631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1277/2585] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:58.630985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.632406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:58.647108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad9d4-eeb4-4c43-9e2c-d68d8e03ba57 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:58.653824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:58.654705 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.655092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.655202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] PATH_INFO: `/v3/projects/32c8fd8129994055942b264c6c34340e` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.656431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c8fd8129994055942b264c6c34340e)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:58.658471 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:58.708483 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c8fd8129994055942b264c6c34340e', 'request_id': 'req-d930b976-9396-4137-9438-40b539a68eac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.714661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c8fd8129994055942b264c6c34340e', 'request_id': 'req-d930b976-9396-4137-9438-40b539a68eac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.720488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c8fd8129994055942b264c6c34340e', 'request_id': 'req-d930b976-9396-4137-9438-40b539a68eac'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.737094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] The token cache is being invalidate because project 32c8fd8129994055942b264c6c34340e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:19:58.737383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.738128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d930b976-9396-4137-9438-40b539a68eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:58.739782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1309/2586] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:19:58 2022] DELETE /identity/v3/projects/32c8fd8129994055942b264c6c34340e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:19:58.745057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.745344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.745621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.764315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:58.765580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:58.782961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:58.827814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1278/2587] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:19:58.835946 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.836248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.836555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.857713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:58.858937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:58.867768 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1310/2588] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:58.872043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.881991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1d9f-788f-489c-8d5e-3cf2bcf49cc7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:58.886693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:58.887360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.887646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.887927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.888698 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:19:58.889009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:58.890630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:58.902331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1279/2589] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:19:58.906696 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.916552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1ce0-6529-456c-b90a-f6777eabe7e4 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:58.922293 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:58.922951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:58.923234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:58.923507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:58.924201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:58.926120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:58.955288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1311/2590] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:58.959655 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:58.970107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269de8-f565-4880-b6f4-63d4afe4af0f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.027086 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.027797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.028061 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.028345 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.029041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.030945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.055107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1280/2591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:19:58 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:19:59.057023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.067630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea260163-139a-41fa-9579-f4a4371741ce admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.072482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.073191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.073470 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.073744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.074493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.076088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.088492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1312/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:19:59.090748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.101041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318c061-6aca-4319-b810-0a40f0596e36 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.106147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.106812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.107088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.107354 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.108093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.109823 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d74005-fb6b-4eb9-8581-1005cbaa3ee9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.120853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1281/2593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:19:59.125139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.134930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437a47b-b289-4893-a68a-22e5629e532c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.139395 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.140274 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.140905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.140905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] PATH_INFO: `/v3/projects/17cd44d2640347b4bc4688e3eed5fdaf/users/12c29522f1bc4836b36b1a61ec1a5b18/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.155487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17cd44d2640347b4bc4688e3eed5fdaf, user_id=12c29522f1bc4836b36b1a61ec1a5b18, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.158158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.173410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1313/2594] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:19:59 2022] PUT /identity/v3/projects/17cd44d2640347b4bc4688e3eed5fdaf/users/12c29522f1bc4836b36b1a61ec1a5b18/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:19:59.185522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.185817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.186100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.214475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] MFA Rules not processed for user `12c29522f1bc4836b36b1a61ec1a5b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:59.216095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:59.284645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1282/2595] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:59.296663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.298595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:59.321779 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:59.367956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e82a18-a92f-461f-987b-9253043733b3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.373156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.373824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.374132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.374432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.384487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.386459 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e522-3f88-4be5-bfc9-71202c90368d service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.396412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1314/2596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:19:59.421542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.441479 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:59.489408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18f5b5-0dd3-4618-8077-d493df7da600 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.494673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.495567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.495877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.496160 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] PATH_INFO: `/v3/users/12c29522f1bc4836b36b1a61ec1a5b18` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.497426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c29522f1bc4836b36b1a61ec1a5b18)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.499419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.553230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c29522f1bc4836b36b1a61ec1a5b18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:59.553891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c29522f1bc4836b36b1a61ec1a5b18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:59.554485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c29522f1bc4836b36b1a61ec1a5b18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:59.562561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c29522f1bc4836b36b1a61ec1a5b18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:59.570271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c29522f1bc4836b36b1a61ec1a5b18'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:19:59.588550 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1283/2597] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:19:59 2022] DELETE /identity/v3/users/12c29522f1bc4836b36b1a61ec1a5b18 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:19:59.593432 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b038c-d69d-4c66-bdb0-49c87aeef7e3 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.593724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b038c-d69d-4c66-bdb0-49c87aeef7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.594002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b038c-d69d-4c66-bdb0-49c87aeef7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.611738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c64b038c-d69d-4c66-bdb0-49c87aeef7e3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:19:59.613354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c64b038c-d69d-4c66-bdb0-49c87aeef7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:59.673758 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1315/2598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:19:59.684043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:19:59.685595 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:19:59.744688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebdb8-266a-40e9-8509-cf2b1b918a7a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:19:59.748898 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:19:59.749707 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.749839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.750099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.760186 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:19:59.761888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae9c7-547e-4393-bd1d-e67373d50a05 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:19:59.772072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1284/2599] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:19:59.984726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.985036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.985287 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] PATH_INFO: `/` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:19:59.986709 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1316/2600] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:19:59.993083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:19:59.993556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:19:59.993912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.014781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.016020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.055023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.057163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.063111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:00.073911 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8ee74-ca91-4117-b0cd-1149a39f1835 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.080161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.081095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.081458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.082219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] PATH_INFO: `/v3/projects/17cd44d2640347b4bc4688e3eed5fdaf` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.084291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17cd44d2640347b4bc4688e3eed5fdaf)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.086342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.109282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1285/2601] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:00.122089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.124304 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.144388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17cd44d2640347b4bc4688e3eed5fdaf', 'request_id': 'req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:00.152932 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17cd44d2640347b4bc4688e3eed5fdaf', 'request_id': 'req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:00.159640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17cd44d2640347b4bc4688e3eed5fdaf', 'request_id': 'req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:00.173781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] The token cache is being invalidate because project 17cd44d2640347b4bc4688e3eed5fdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:20:00.174067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:00.175255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d2841041-690a-48b9-b1a1-8cd4bc3e2fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:00.177169 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1317/2602] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:20:00 2022] DELETE /identity/v3/projects/17cd44d2640347b4bc4688e3eed5fdaf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:20:00.182057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c45c-5357-4996-971c-218de8a8f7a0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.182340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c45c-5357-4996-971c-218de8a8f7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.182615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c45c-5357-4996-971c-218de8a8f7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.188302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5cbd9-d9e3-46fc-bc54-84bf779a1b1a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.200893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4d43c45c-5357-4996-971c-218de8a8f7a0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.202137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4d43c45c-5357-4996-971c-218de8a8f7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.236735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.237392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.237674 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.238004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.239795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.246231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:00.275784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1318/2603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:20:00.277452 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.277711 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.277989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.295567 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.296835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.305273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1319/2604] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:20:00.309805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.318743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb1f6-7da3-4322-919f-5141287d4dd1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.322376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.323514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.323871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.324193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.324550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.324777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.325492 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:20:00.325792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.327383 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.335422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1286/2605] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:00.339024 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1320/2606] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:20:00.343720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.354356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c15bd-a648-4793-917f-d737a4fc8464 service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.360238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.360960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.361243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.361520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.362227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.364162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d0ea9-96c3-48c9-96c1-fa0b8831a7cf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.394360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1287/2607] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:20:00.398635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.406866 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a72d7-a043-4510-95ce-d7995694cb5f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.407295 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a72d7-a043-4510-95ce-d7995694cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.407682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a72d7-a043-4510-95ce-d7995694cb5f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.408754 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbed72-f90c-4c59-b69b-4837abdc4247 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.409318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1288/2608] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 16:20:00.414230 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.414451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.414730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.428427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:00.434409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] MFA Rules not processed for user `e55aa833284d4f73932873f884f1bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.436344 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.467480 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.468434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.468752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.469029 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.469717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.471684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.496067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1321/2609] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:00.496310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1289/2610] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:20:00.497151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.507020 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959fa6-8baa-4f43-a021-9fead5c28d93 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.508208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.509738 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.511551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.512215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.512531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.512811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.513541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.515138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.520488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a79388-3848-4e06-b6f8-57f1af25f44a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.524317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.525074 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.525356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.528493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1322/2611] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:20:00.528618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.529439 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.533112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.534580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.538790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e52f-4397-4158-802a-5fbe43ef10bb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.542717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1290/2612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:00.543355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.544049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.544334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.544639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.545355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.546925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcde573-3f4e-45cc-83bd-9187d6728ee0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.560062 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1323/2613] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:20:00.564363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.575659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215615b-d4ea-4ff3-974c-7b1ebc3e0be0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.580969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.582081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.582368 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.583070 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] PATH_INFO: `/v3/projects/6353d67cb8cb4be0aa7dc1936cbbf04a/users/94b873bd2b4d41289d59668728ec644f/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.598316 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6353d67cb8cb4be0aa7dc1936cbbf04a, user_id=94b873bd2b4d41289d59668728ec644f, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.601057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fa2f3-2739-4310-94c3-cb26041c8e75 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.616774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1291/2614] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:00 2022] PUT /identity/v3/projects/6353d67cb8cb4be0aa7dc1936cbbf04a/users/94b873bd2b4d41289d59668728ec644f/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:00.622035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.622329 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.622615 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.625745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04a3-ed14-4809-8dd5-a7d5671355c1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.626038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04a3-ed14-4809-8dd5-a7d5671355c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.626319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd04a3-ed14-4809-8dd5-a7d5671355c1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.627710 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1292/2615] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 5 16:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 16:20:00.632507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.632793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.633069 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.639951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.641195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.650812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] MFA Rules not processed for user `9bb2c2c6299946e1a172eb6948b28094`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:00.651999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:00.701803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1324/2616] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:00.711225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.721424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1293/2617] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 5 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:20:00.732044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:00.750963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:00.768495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f698c-47e7-4f3a-96ab-e7f10680c6cd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.773454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.774427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.774427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.774652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.784382 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.786273 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b1c1-011f-4b75-940b-e60c15e69fae service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.797017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1325/2618] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:20:00.799055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c206ae-4770-497c-9f4a-5d1038b4949b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:00.802921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:00.803574 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:00.803859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:00.804136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:00.815816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:00.817430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:00.837752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1294/2619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:20:02.677614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bafbb-c0b6-4a5e-8677-893feefdb239 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:02.678144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bafbb-c0b6-4a5e-8677-893feefdb239 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:02.678144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bafbb-c0b6-4a5e-8677-893feefdb239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:02.697261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f11bafbb-c0b6-4a5e-8677-893feefdb239 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:02.698493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f11bafbb-c0b6-4a5e-8677-893feefdb239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:02.756799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1326/2620] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:02.769746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:02.771276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:02.787022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:02.844858 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402f2b8-1a1f-472d-898c-2fdd36d84e44 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:02.850019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:02.850680 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:02.850981 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:02.851242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:02.860542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:02.862151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:02.871533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1295/2621] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:20:06.021940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.022484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.022757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.069789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] MFA Rules not processed for user `94b873bd2b4d41289d59668728ec644f`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:06.072771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:06.199863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1327/2622] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:06.204310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.231507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed896122-3d71-4647-a7cc-bf5154fe9579 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.244005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.252468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.253446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.254185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.255836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.258255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.317847 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1296/2623] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:20:06 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:06.321667 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.344022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbf8ef-8295-4a8c-9137-2bb97fed2acf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.490581 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.491408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.491955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.492070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.492881 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.495055 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.536306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1328/2624] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:20:06 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:20:06.540085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.555149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990bc5-1754-4599-af39-7001a1c02995 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.570423 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.571176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.571466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.571782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.572763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.575832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.591810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1297/2625] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:06.595746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.608322 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:06.616327 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336b4d-6f9f-4b3d-a52e-ce0213b86d50 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.628848 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.629958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.630339 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.630715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] PATH_INFO: `/v3/projects/e6dac3e8d4f14378a669edb0c1372e99/users/0fbc403db84b4f7380a978fc45fdfbea/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.664044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dac3e8d4f14378a669edb0c1372e99, user_id=0fbc403db84b4f7380a978fc45fdfbea, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.668380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.694249 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1329/2626] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:06 2022] PUT /identity/v3/projects/e6dac3e8d4f14378a669edb0c1372e99/users/0fbc403db84b4f7380a978fc45fdfbea/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:20:06.698317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.712384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977ca34-9c92-48b8-971a-7a0a1186963f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.798601 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.799296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.799621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.799900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.800891 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.802883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d0c2-f933-4bf1-806c-65046957ddd4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.816672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1298/2627] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:20:06.820708 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:06.831982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbe-66e4-472e-9de4-78416c257b0c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:06.837717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:06.838759 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:06.839197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:06.839529 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] PATH_INFO: `/v3/projects/e6dac3e8d4f14378a669edb0c1372e99/users/0fbc403db84b4f7380a978fc45fdfbea/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:06.841919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dac3e8d4f14378a669edb0c1372e99, user_id=0fbc403db84b4f7380a978fc45fdfbea, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:06.845111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:06.857233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1330/2628] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:06 2022] PUT /identity/v3/projects/e6dac3e8d4f14378a669edb0c1372e99/users/0fbc403db84b4f7380a978fc45fdfbea/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:13.298451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031b08-5913-4a7f-b0da-cd4976a167d3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:13.299032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031b08-5913-4a7f-b0da-cd4976a167d3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:13.299032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031b08-5913-4a7f-b0da-cd4976a167d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:13.328545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-70031b08-5913-4a7f-b0da-cd4976a167d3 None None] MFA Rules not processed for user `0fbc403db84b4f7380a978fc45fdfbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:13.329778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-70031b08-5913-4a7f-b0da-cd4976a167d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:13.400768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:13.426153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1299/2629] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:13.524258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:13.526051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:13.601839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3038d-bc45-4955-9c99-455785ab9614 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:13.607761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:13.608564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:13.608740 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:13.609021 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:13.692756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:13.694363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530636-5bc7-4c20-b0eb-33865f0de801 service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:13.704525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1331/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:14.802125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:14.802615 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:14.802791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:14.824162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] MFA Rules not processed for user `94b873bd2b4d41289d59668728ec644f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:14.825415 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:14.832598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1300/2631] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:23.565414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:23.565944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:23.565944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:23.590584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:23.591796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:23.649335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1332/2632] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:23.661590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:23.741643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3df390-507a-4278-a77f-a2707adfd451 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:23.746740 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:23.747395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:23.747672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:23.747941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:23.756564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:23.758136 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:23.766559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1301/2633] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:20:33.642194 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:33.763127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=39 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:37.620588 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:37.622196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:37.686602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1235e0-5f4a-4590-8805-8c8f1bd7430a None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:37.690297 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:37.690959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:37.691238 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:37.691507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:37.693312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:37.763862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:37.765500 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:37.775355 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1333/2634] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:40.998170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:40.999937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:41.018600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee990f-0e11-4439-a991-199bf87a3799 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.024805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.025810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.026279 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.026643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] PATH_INFO: `/v3/users/d49798cb46a84cc8abad89604ec784f9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.028277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49798cb46a84cc8abad89604ec784f9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.030872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.097998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49798cb46a84cc8abad89604ec784f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.099062 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49798cb46a84cc8abad89604ec784f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.099673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49798cb46a84cc8abad89604ec784f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.106999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49798cb46a84cc8abad89604ec784f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.115836 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9b419213-4ce5-4ff1-882b-da441f04c00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49798cb46a84cc8abad89604ec784f9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.135760 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1302/2635] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:20:40 2022] DELETE /identity/v3/users/d49798cb46a84cc8abad89604ec784f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:41.311501 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.322098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503eba-5f32-44c5-8935-dfb0406bd86e service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.403231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.404620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.405129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.405456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] PATH_INFO: `/v3/projects/f125705e83fb4982a34a20211c57ed58` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.406775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f125705e83fb4982a34a20211c57ed58)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.408970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.474350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f125705e83fb4982a34a20211c57ed58', 'request_id': 'req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.476743 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:41.482573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f125705e83fb4982a34a20211c57ed58', 'request_id': 'req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.489712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f125705e83fb4982a34a20211c57ed58', 'request_id': 'req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.505356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] The token cache is being invalidate because project f125705e83fb4982a34a20211c57ed58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:20:41.505861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.506455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-0d67d875-b161-49d7-b1a4-fad08b0b9bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:41.508334 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1334/2636] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:20:41 2022] DELETE /identity/v3/projects/f125705e83fb4982a34a20211c57ed58 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:41.513381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.513691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.513962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.533257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:41.534481 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:41.596701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1303/2637] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:41.605014 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.605300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.605600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.625427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:41.627078 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:41.637494 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1335/2638] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:41.642146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.653155 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf3799-997e-4283-b1c9-1a150b015739 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.659356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.659951 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.660242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.660548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.661277 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:20:41.661585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.663195 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.675903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1304/2639] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:20:41.682718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.694049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988b25-4279-432f-9394-7f50bc9331f1 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.700088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.700749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.701027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.701303 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.701995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.703954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.732906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1336/2640] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:41.737152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.747750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ab5b-d3a1-4015-8718-04515d4d7dc7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.808208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.808940 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.809228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.809499 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.810189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.812204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.818784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:41.834336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1305/2641] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:20:41 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:41.839079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.851530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a30db-36a3-409f-a731-171ab5cea3ed admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.857455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.858119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.858400 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.858671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.859441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.861156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.872222 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1337/2642] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:41.876837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.887733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196bc32-c6d4-459a-933b-9b5b4f63dbfd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.893267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.893935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.894243 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.894502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.895233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.896973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d99d-b2b5-4735-bfef-9132cae083e4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.907189 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1306/2643] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:41.911506 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:41.922125 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858093-11a4-4544-92f4-ce7a876d0052 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:41.927411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:41.928299 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.928622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.928904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] PATH_INFO: `/v3/projects/89cbf61815424c53ae99a34007917937/users/e3f8a79eb1f943dcaf5309cb5c64a5f7/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:41.944288 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cbf61815424c53ae99a34007917937, user_id=e3f8a79eb1f943dcaf5309cb5c64a5f7, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:41.946988 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:41.962417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1338/2644] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:41 2022] PUT /identity/v3/projects/89cbf61815424c53ae99a34007917937/users/e3f8a79eb1f943dcaf5309cb5c64a5f7/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:41.973522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:41.973883 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:41.974287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.006939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] MFA Rules not processed for user `e3f8a79eb1f943dcaf5309cb5c64a5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:42.008143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:42.084152 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1307/2645] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:42.088918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.153917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7142-8193-42fb-90ce-3c2eda8d29e8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.159233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.159938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.160215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.160515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.161205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.164164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.197586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1339/2646] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:20:42 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:42.201654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.222004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e730c7-4ccb-485a-82ff-92f1828da520 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.280911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.281631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.281917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.282194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.282927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.284947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.305602 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1308/2647] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:20:42 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:20:42.309275 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.320041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe98c-edf0-4722-b3c9-d1fa945df269 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.328072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.328962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.329262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.329541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.335550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.337224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.349800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1340/2648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:42.354144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.364482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95e98-f5e9-4cff-8d52-e9992cf62773 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.369527 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.370402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.370677 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.370945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] PATH_INFO: `/v3/projects/816d531fb74145f9b73b320e2f6c075a/users/f42e4a92d2c34d2f93d4597868f5c63d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.385752 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816d531fb74145f9b73b320e2f6c075a, user_id=f42e4a92d2c34d2f93d4597868f5c63d, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.388392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.403402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1309/2649] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:42 2022] PUT /identity/v3/projects/816d531fb74145f9b73b320e2f6c075a/users/f42e4a92d2c34d2f93d4597868f5c63d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:20:42.407476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.417335 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4e4d3-3345-4448-bd60-d7595cc0020b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.463141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:42.476084 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.476808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.477093 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.477376 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.478258 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.479927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886af8dd-9a9d-4032-9e27-4927ab9f69a8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.492342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1341/2650] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:42.496852 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.508772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef112-e4d4-4fc6-b7f2-7eaa1d92d8a6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.515048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.515942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.516228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.516542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] PATH_INFO: `/v3/projects/816d531fb74145f9b73b320e2f6c075a/users/f42e4a92d2c34d2f93d4597868f5c63d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.518795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=816d531fb74145f9b73b320e2f6c075a, user_id=f42e4a92d2c34d2f93d4597868f5c63d, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.521513 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.532778 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1310/2651] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:42 2022] PUT /identity/v3/projects/816d531fb74145f9b73b320e2f6c075a/users/f42e4a92d2c34d2f93d4597868f5c63d/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:20:42.547838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.548132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.548405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.577192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] MFA Rules not processed for user `f42e4a92d2c34d2f93d4597868f5c63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:42.578394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:42.650748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1342/2652] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:42.665020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:42.666894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:42.691020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:42.728372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0342-2973-49a2-be68-6eb99f3534fd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:42.732666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:42.733312 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:42.733631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:42.733909 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:42.795781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:42.797286 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:42.807266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1311/2653] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:45.445718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:45.455349 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc986-7ae6-434d-8262-5ef83a6cb473 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:45.459073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:45.459714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:45.459989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:45.460259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:45.469570 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:45.471007 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:45.481350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1343/2654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:47.320840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:47.322329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:47.383046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952215a-b3e0-4dff-8843-49f8516d2210 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:47.387084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:47.387768 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:47.388051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:47.388334 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:47.390512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:47.453660 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:47.455237 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99323-366a-4afb-8dea-0f79fcd4c5de service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:47.465594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1312/2655] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:55.476559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=46 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:57.461223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:58.040747 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:58.111933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211862-f3f3-400c-a6f4-0dced4bff1ce service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:58.119008 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:58.119913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:58.120197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:58.120487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] PATH_INFO: `/v3/users/e3f8a79eb1f943dcaf5309cb5c64a5f7` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:58.121833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f8a79eb1f943dcaf5309cb5c64a5f7)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:58.123839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:58.174106 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f8a79eb1f943dcaf5309cb5c64a5f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.174788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f8a79eb1f943dcaf5309cb5c64a5f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.175369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f8a79eb1f943dcaf5309cb5c64a5f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.182539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f8a79eb1f943dcaf5309cb5c64a5f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.191281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f8a79eb1f943dcaf5309cb5c64a5f7'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.208279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1344/2656] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:20:58 2022] DELETE /identity/v3/users/e3f8a79eb1f943dcaf5309cb5c64a5f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:58.213040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:58.213325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:58.213631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:58.233000 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:58.234220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:58.294003 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1313/2657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:58.304347 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:58.305980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:58.367406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff78906-e4e1-413f-abdb-ca6a7c293198 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:58.371256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:58.371900 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:58.372181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:58.372469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:58.382110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:58.383557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:58.393073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1345/2658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:20:58.683330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:58.684919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:58.697517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313711f-9af6-4ed3-97af-2c51423e54df None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:58.703802 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:58.704744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:58.705001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:58.705275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] PATH_INFO: `/v3/projects/89cbf61815424c53ae99a34007917937` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:58.706628 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cbf61815424c53ae99a34007917937)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:58.708587 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:58.760812 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cbf61815424c53ae99a34007917937', 'request_id': 'req-423e0547-44f6-4390-927f-ba3477e4377d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.766559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cbf61815424c53ae99a34007917937', 'request_id': 'req-423e0547-44f6-4390-927f-ba3477e4377d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.777458 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cbf61815424c53ae99a34007917937', 'request_id': 'req-423e0547-44f6-4390-927f-ba3477e4377d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.793374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] The token cache is being invalidate because project 89cbf61815424c53ae99a34007917937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:20:58.793669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.794440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.796191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1314/2659] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:20:58 2022] DELETE /identity/v3/projects/89cbf61815424c53ae99a34007917937 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:58.800356 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:58.811466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d02d-c556-4c81-9110-b4a637a5a7eb service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:58.832145 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:58.874085 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:58.874982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:58.875263 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:58.875538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] PATH_INFO: `/v3/users/f42e4a92d2c34d2f93d4597868f5c63d` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:58.876772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42e4a92d2c34d2f93d4597868f5c63d)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:58.878752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:58.926034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42e4a92d2c34d2f93d4597868f5c63d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.926692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42e4a92d2c34d2f93d4597868f5c63d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.927307 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42e4a92d2c34d2f93d4597868f5c63d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.934525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42e4a92d2c34d2f93d4597868f5c63d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.942462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ca81ddf3-aea8-4e6f-8f91-1fa65658d731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42e4a92d2c34d2f93d4597868f5c63d'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:58.959954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1346/2660] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:20:58 2022] DELETE /identity/v3/users/f42e4a92d2c34d2f93d4597868f5c63d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:59.246658 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.248336 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:59.262427 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0547-44f6-4390-927f-ba3477e4377d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.324972 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.325905 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.326282 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.326745 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] PATH_INFO: `/v3/projects/816d531fb74145f9b73b320e2f6c075a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.328846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=816d531fb74145f9b73b320e2f6c075a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.331646 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.370131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:59.387300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816d531fb74145f9b73b320e2f6c075a', 'request_id': 'req-e0953e93-eb6a-4b7d-951d-d8f90344e85c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:59.392773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816d531fb74145f9b73b320e2f6c075a', 'request_id': 'req-e0953e93-eb6a-4b7d-951d-d8f90344e85c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:59.401664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816d531fb74145f9b73b320e2f6c075a', 'request_id': 'req-e0953e93-eb6a-4b7d-951d-d8f90344e85c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:59.413146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] The token cache is being invalidate because project 816d531fb74145f9b73b320e2f6c075a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:20:59.413437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:59.414107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e0953e93-eb6a-4b7d-951d-d8f90344e85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:20:59.415671 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1315/2661] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:20:59 2022] DELETE /identity/v3/projects/816d531fb74145f9b73b320e2f6c075a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:59.420880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.421371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.421371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.441230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:59.442654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:59.511925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1347/2662] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:59.519747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.520125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.520506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.539026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:59.540222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:59.548542 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1316/2663] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:59.552739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.563348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfef9a-727b-4225-a1bb-94de2afc308c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.569544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.570203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.570599 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.570877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.571608 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:20:59.571919 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.573582 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.585336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1348/2664] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:20:59.589641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.599101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23dbb9-0090-4d0d-a948-89a44c1e43c5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.604477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.605144 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.605426 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.605695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.606372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.608268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.636958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1317/2665] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:20:59 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:59.640978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.651172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1a67-6eeb-40a2-a024-91730ac08e2d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.676897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:59.710983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.711661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.711944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.712225 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.712940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.714865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.736702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1349/2666] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:20:59 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:20:59.741216 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.751924 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7336379-db4b-44af-9ec0-a4ab73e4b632 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.757365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.758213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.758503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.758781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.759546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.761766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.775762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1318/2667] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:59.781965 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.798543 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da946d-9fae-4844-8622-97c77e89f7ec admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.806438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.807094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.807358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.807634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.808360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.809993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd2b0-068e-46bd-b33c-4acc1ffbd6d1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.820142 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1350/2668] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:20:59.824429 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.834863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698418a-7f02-4152-89ba-850ccae5513e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:20:59.840146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:20:59.841001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.841280 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.841556 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] PATH_INFO: `/v3/projects/92250d6cabcc4a1688661a1d88328b38/users/7482db8322664fbdb7ddeb48dd2e4214/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.856497 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92250d6cabcc4a1688661a1d88328b38, user_id=7482db8322664fbdb7ddeb48dd2e4214, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:20:59.859134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:20:59.875006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1319/2669] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:20:59 2022] PUT /identity/v3/projects/92250d6cabcc4a1688661a1d88328b38/users/7482db8322664fbdb7ddeb48dd2e4214/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:20:59.880203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ffa5-4b73-412c-95f2-270114407024 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:20:59.880525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ffa5-4b73-412c-95f2-270114407024 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:20:59.880804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ffa5-4b73-412c-95f2-270114407024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:20:59.899530 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-62a7ffa5-4b73-412c-95f2-270114407024 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:20:59.900864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-62a7ffa5-4b73-412c-95f2-270114407024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:20:59.960940 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1351/2670] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:20:59.972411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:20:59.975100 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:00.040991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b7801-f216-437e-ab12-1ad2d5652553 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:00.044921 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:00.045566 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.045845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.046121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:00.055961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:00.057446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:00.067824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1320/2671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:00.683737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.684284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.684284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:00.710096 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] MFA Rules not processed for user `7482db8322664fbdb7ddeb48dd2e4214`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:00.711372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:00.778596 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1352/2672] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:00.783272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:00.793867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571326-0c88-41ad-8b76-c25db6321d4b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:00.798412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:00.799083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.799366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.799644 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:00.800335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:00.802285 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:00.830035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1321/2673] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:00 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:00.834257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:00.846176 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82a91-d9c0-41a8-adb6-611aeadf08bd None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:00.884130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:00.910938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:00.911631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.911909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.912183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:00.912942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:00.914989 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:00.940354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1353/2674] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:00 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:00.941767 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:00.953048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf13e-833a-4806-8f5c-7d6ab82d3e9b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:00.958578 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:00.959258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.959541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.959818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:00.960589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:00.962261 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:00.976559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1322/2675] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:00.977937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:00.989342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db308-6e01-4ea7-87fe-9344c794814e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:00.994371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:00.995490 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:00.995606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:00.995819 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] PATH_INFO: `/v3/projects/52aafdce30c64c30a6318263e3806cd8/users/000e88cc59a8467c98eb2c7ad5ce9699/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:01.013997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52aafdce30c64c30a6318263e3806cd8, user_id=000e88cc59a8467c98eb2c7ad5ce9699, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:01.016920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:01.032183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1354/2676] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:00 2022] PUT /identity/v3/projects/52aafdce30c64c30a6318263e3806cd8/users/000e88cc59a8467c98eb2c7ad5ce9699/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:01.036251 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:01.046704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebcda9-1baf-42b6-b4df-d3c79c5fff5d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:01.063446 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:01.104954 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:01.105623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:01.105911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:01.106190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:01.106920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:01.108525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddd6cb-2c89-4e12-98a9-66115b7012f8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:01.121132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1323/2677] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:01.125646 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:01.138688 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a48d1-98c9-4ef6-93a3-c59455420017 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:01.144149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:01.145073 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:01.145353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:01.145627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] PATH_INFO: `/v3/projects/52aafdce30c64c30a6318263e3806cd8/users/000e88cc59a8467c98eb2c7ad5ce9699/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:01.147889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52aafdce30c64c30a6318263e3806cd8, user_id=000e88cc59a8467c98eb2c7ad5ce9699, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:01.150645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddf9fa-21c2-47ae-b366-18844540f0e7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:01.162203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1355/2678] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:01 2022] PUT /identity/v3/projects/52aafdce30c64c30a6318263e3806cd8/users/000e88cc59a8467c98eb2c7ad5ce9699/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:01.790851 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:01.791445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:01.791445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:01.818761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] MFA Rules not processed for user `000e88cc59a8467c98eb2c7ad5ce9699`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:01.819971 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:01.892547 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1324/2679] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:01.902850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:01.903368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:01.903462 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:01.920973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] MFA Rules not processed for user `7482db8322664fbdb7ddeb48dd2e4214`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:01.922113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:01.979991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1356/2680] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:01.993376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:01.995039 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:02.069886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df28eb-dbd2-487a-84f8-a47fd49faaed None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:02.076407 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:02.077199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:02.077471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:02.077753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:02.085842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:02.087521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:02.096238 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1325/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:03.279132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:03.280714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:03.352806 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960cdd-8cfa-4188-92ec-7062802b4cfe None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:03.358143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:03.358892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:03.359177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:03.359454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:03.361389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:03.373179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:03.374774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:03.384745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1357/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:12.092693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:13.380344 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:15.190716 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:15.192387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:15.253750 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8fc3-1528-490e-86a0-f04903794035 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:15.257918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:15.258563 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:15.258845 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:15.259123 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:15.268598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:15.270038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:15.280314 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1326/2683] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:25.275933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=26 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:34.815179 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:34.816735 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:34.831968 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05ae2-f2a6-46cb-a6a7-f039725afc65 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:34.838066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:34.838803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:34.839154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:34.839499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:34.841389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:34.854431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:34.855938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:34.867438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1358/2684] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:35.391641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:35.403859 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b2d3f-629d-457f-858a-61bf873684ad service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:35.409465 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:35.410124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:35.410412 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:35.410691 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:35.412744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:35.433147 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:35.434944 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:35.446262 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1327/2685] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:35.458722 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:35.534783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b5ddc-f056-4f9e-9d6a-ba5dbaf344ad service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:35.539458 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:35.540346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:35.540847 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:35.541132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] PATH_INFO: `/v3/users/7482db8322664fbdb7ddeb48dd2e4214` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:35.543773 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7482db8322664fbdb7ddeb48dd2e4214)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:35.545981 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:35.593830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7482db8322664fbdb7ddeb48dd2e4214'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.594467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7482db8322664fbdb7ddeb48dd2e4214'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.595050 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7482db8322664fbdb7ddeb48dd2e4214'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.602542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7482db8322664fbdb7ddeb48dd2e4214'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.610488 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7482db8322664fbdb7ddeb48dd2e4214'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.628463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1359/2686] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:35 2022] DELETE /identity/v3/users/7482db8322664fbdb7ddeb48dd2e4214 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:35.812744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:35.825064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e70c-abf4-4b6b-a404-c64bfa117e6d service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:35.886452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:35.887612 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:35.887892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:35.888191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] PATH_INFO: `/v3/projects/92250d6cabcc4a1688661a1d88328b38` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:35.890072 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92250d6cabcc4a1688661a1d88328b38)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:35.893122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:35.945506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92250d6cabcc4a1688661a1d88328b38', 'request_id': 'req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.951359 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92250d6cabcc4a1688661a1d88328b38', 'request_id': 'req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.960995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92250d6cabcc4a1688661a1d88328b38', 'request_id': 'req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.972209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] The token cache is being invalidate because project 92250d6cabcc4a1688661a1d88328b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:35.972549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.973269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:35.974874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1328/2687] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:35 2022] DELETE /identity/v3/projects/92250d6cabcc4a1688661a1d88328b38 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:35.978996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:35.980473 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:35.994564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0498f-9348-4664-94dd-ef77cffed8bf admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.061445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.062337 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.062626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.062913 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] PATH_INFO: `/v3/users/000e88cc59a8467c98eb2c7ad5ce9699` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.064139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000e88cc59a8467c98eb2c7ad5ce9699)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.066148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.071742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:36.116219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000e88cc59a8467c98eb2c7ad5ce9699'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.116924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000e88cc59a8467c98eb2c7ad5ce9699'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.117544 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000e88cc59a8467c98eb2c7ad5ce9699'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.124504 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000e88cc59a8467c98eb2c7ad5ce9699'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.133272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-478e8f94-c6a9-4057-b410-283d37f6fcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000e88cc59a8467c98eb2c7ad5ce9699'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.151212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1360/2688] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:35 2022] DELETE /identity/v3/users/000e88cc59a8467c98eb2c7ad5ce9699 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:36.336635 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.339327 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:36.358349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11a2-bcca-46e1-b4c3-963e2e2bff59 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.420498 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.421350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.421627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.421888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] PATH_INFO: `/v3/projects/52aafdce30c64c30a6318263e3806cd8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.423071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] RBAC: Authorizing `identity:delete_project(project_id=52aafdce30c64c30a6318263e3806cd8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.425101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.445861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:36.473085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aafdce30c64c30a6318263e3806cd8', 'request_id': 'req-15ee8daf-87b8-468f-bca6-acead04503de'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.478779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aafdce30c64c30a6318263e3806cd8', 'request_id': 'req-15ee8daf-87b8-468f-bca6-acead04503de'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.487606 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aafdce30c64c30a6318263e3806cd8', 'request_id': 'req-15ee8daf-87b8-468f-bca6-acead04503de'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.499633 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] The token cache is being invalidate because project 52aafdce30c64c30a6318263e3806cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:36.499930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.500662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15ee8daf-87b8-468f-bca6-acead04503de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:36.502321 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1329/2689] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:36 2022] DELETE /identity/v3/projects/52aafdce30c64c30a6318263e3806cd8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:36.507597 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.507887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.508207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.527593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:36.528861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:36.591814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1361/2690] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:36.600168 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.600467 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.600765 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.623320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:36.624676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:36.633867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1330/2691] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:36.639692 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.648302 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332099-8c82-4e24-b62b-e79f097f7244 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.652834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.653497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.653851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.654126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.654897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:21:36.655203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.656835 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.671766 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1362/2692] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:21:36.672860 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.683666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5722b8-580d-4504-8a66-76ec749134a3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.688308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.688989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.689269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.689541 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.689640 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.690223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.691466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:36.692167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.720522 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1331/2693] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:21:36.724622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.752583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7902fc-5975-4dd0-8ae7-0583208107d8 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.778059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:36.788373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81c9b-435a-4987-aa92-0b4f27017ef6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.793568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.794256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.794545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.794828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.795525 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.797689 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.803628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.804419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.804807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.805083 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.806884 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:36.819450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1332/2694] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:36 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:36.820587 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.822256 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.823554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.832486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1363/2695] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:21:36.833774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2338951-cbe4-4150-8bf5-6692de5eaf1e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.839112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.839824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.840093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.840387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.841130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.842846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.853626 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1333/2696] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:36.857645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.867869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf70d-4448-43a9-8329-f1954fdb0a90 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.873920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.874605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.874888 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.875838 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.876605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.878236 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49ff19-df8d-4480-96a5-4edc18e0509d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.888855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1364/2697] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:36.893161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:36.903749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13b1a-c395-42b3-9dc2-a17f4399ba64 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:36.908846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:36.909749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.910028 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.910303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] PATH_INFO: `/v3/projects/82e31bef683d48fd9b905ed7b828dc4d/users/328571e2301d414c9802958bed985251/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.925609 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e31bef683d48fd9b905ed7b828dc4d, user_id=328571e2301d414c9802958bed985251, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:36.928637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:36.943096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1334/2698] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:36 2022] PUT /identity/v3/projects/82e31bef683d48fd9b905ed7b828dc4d/users/328571e2301d414c9802958bed985251/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:36.953361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:36.953809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:36.954171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:36.981368 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] MFA Rules not processed for user `328571e2301d414c9802958bed985251`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:36.982564 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:37.049716 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1365/2699] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:37.061395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:37.063215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:37.100127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:37.128337 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a326f-7f00-4346-bd13-3d17b9d77d2c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:37.132769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:37.133519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.133808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.134085 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.143362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:37.144850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f1459-9cd2-4ebf-89a1-3abe96faae23 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:37.154162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1335/2700] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:37.173738 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:37.236326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd230-cacd-49df-bd3f-89b5f6c6faa7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:37.241864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:37.242753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.243086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.243363 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] PATH_INFO: `/v3/users/328571e2301d414c9802958bed985251` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.244635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328571e2301d414c9802958bed985251)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:37.246610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:37.304852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328571e2301d414c9802958bed985251'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.305498 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328571e2301d414c9802958bed985251'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.306120 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328571e2301d414c9802958bed985251'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.310862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:37.313924 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328571e2301d414c9802958bed985251'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.322833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328571e2301d414c9802958bed985251'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.340094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1366/2701] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:37 2022] DELETE /identity/v3/users/328571e2301d414c9802958bed985251 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:37.344662 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.344957 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.345234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.364209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:37.365462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:37.425709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1336/2702] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:37.435790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:37.437645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:37.499649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd538f-f249-4b6d-a362-8ea561f08dd6 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:37.503370 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:37.504032 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.504319 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.504630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.514123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:37.515619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea8e5f-6081-4d16-bfdb-77403f6a9b48 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:37.525643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1367/2703] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:21:37.820834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:37.822682 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:37.841287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d7832-b6fd-47b6-8e7f-8bd784ecdfb8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:37.846874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:37.847762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.848042 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.848313 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] PATH_INFO: `/v3/projects/82e31bef683d48fd9b905ed7b828dc4d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.849546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e31bef683d48fd9b905ed7b828dc4d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:37.851469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:37.912242 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e31bef683d48fd9b905ed7b828dc4d', 'request_id': 'req-2069fd4f-daf4-4590-900b-7e7292b263b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.918222 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e31bef683d48fd9b905ed7b828dc4d', 'request_id': 'req-2069fd4f-daf4-4590-900b-7e7292b263b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.926273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e31bef683d48fd9b905ed7b828dc4d', 'request_id': 'req-2069fd4f-daf4-4590-900b-7e7292b263b8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.938043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] The token cache is being invalidate because project 82e31bef683d48fd9b905ed7b828dc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:37.938330 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.938965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2069fd4f-daf4-4590-900b-7e7292b263b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:37.940557 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1337/2704] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:37 2022] DELETE /identity/v3/projects/82e31bef683d48fd9b905ed7b828dc4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:37.945440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:37.945751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:37.946031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:37.963832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:37.965110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:38.028784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1368/2705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:38.036440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.036841 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.037200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.057012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:38.058318 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:38.066640 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1338/2706] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:38.071052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.080935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdca61-d877-46ea-95d1-a8babd0e46c0 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.085820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.086507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.086771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.087041 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.087844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:21:38.088152 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.089784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.104959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1369/2707] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:21:38.106046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.115734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708694c5-657f-4850-8757-2c98080f24b1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.121452 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.122117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.122398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.122667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.123373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.125382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.156400 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1339/2708] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:38 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:38.160346 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.171820 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8461d-e1d7-4de5-8c0a-06f70f546612 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.246051 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.246959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.247157 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.247559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.248801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.250464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.258123 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:38.277774 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1370/2709] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:38 2022] POST /identity/v3/users => generated 280 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:38.279182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.289779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c1db-e6e7-494d-a3aa-4200497de362 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.294907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.295684 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.296027 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.296382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.297212 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.298943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.310895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1340/2710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:38.314776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.324920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1439-f8cd-4e34-a724-6c18ef2acbe1 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.329757 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.330710 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.330870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.331127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.331894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.334875 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f82de-388f-404d-b850-58173e9abbbc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.345057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1371/2711] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:38.349608 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.361647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52590-1dd4-4bd2-964f-ee9a5895c49c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.366667 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.367727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.368080 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.368490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] PATH_INFO: `/v3/projects/eebe5830661244958587f7060517c117/users/bbc06ee1f7e448ae985d5c8ee1d1eac2/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.384361 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebe5830661244958587f7060517c117, user_id=bbc06ee1f7e448ae985d5c8ee1d1eac2, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.387161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.391840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:38.407580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1341/2712] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:38 2022] PUT /identity/v3/projects/eebe5830661244958587f7060517c117/users/bbc06ee1f7e448ae985d5c8ee1d1eac2/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:38.418783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.419086 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.419518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.450793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] MFA Rules not processed for user `bbc06ee1f7e448ae985d5c8ee1d1eac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:38.452321 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:38.532575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1372/2713] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:38.568034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.569900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:38.633943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570610-1c34-44ef-9114-193b7b0dfa07 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.638191 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.638869 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.639208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.639485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.648810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.650259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ec7fa-588e-46fa-b6c3-52a43b1a66a7 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.659912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1342/2714] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:38.674296 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.747371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efffb2-774b-408c-a7d9-f72aacddd8a7 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:38.753338 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:38.757750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.757750 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.758056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] PATH_INFO: `/v3/users/bbc06ee1f7e448ae985d5c8ee1d1eac2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.759614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc06ee1f7e448ae985d5c8ee1d1eac2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:38.762203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:38.813059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc06ee1f7e448ae985d5c8ee1d1eac2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:38.813836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc06ee1f7e448ae985d5c8ee1d1eac2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:38.814430 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc06ee1f7e448ae985d5c8ee1d1eac2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:38.821772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc06ee1f7e448ae985d5c8ee1d1eac2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:38.829580 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc06ee1f7e448ae985d5c8ee1d1eac2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:38.835379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:38.850928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1373/2715] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:38 2022] DELETE /identity/v3/users/bbc06ee1f7e448ae985d5c8ee1d1eac2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:38.855639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:38.855926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:38.856402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:38.875515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:38.876763 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:38.936751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1343/2716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:38.948342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:38.951092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:39.015991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5069-dc81-4427-8155-98e554a0835f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:39.019562 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:39.020212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.020509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.020799 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.030196 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:39.032231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b063c-62bb-468d-9c4e-6dd40f0a8472 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:39.042059 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1374/2717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:39.581861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:39.584274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:39.600293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573fb35-b593-4473-903e-5c90bc7ea2f6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:39.608514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:39.610200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.610589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.611444 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] PATH_INFO: `/v3/projects/eebe5830661244958587f7060517c117` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.613819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebe5830661244958587f7060517c117)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:39.616107 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:39.698911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebe5830661244958587f7060517c117', 'request_id': 'req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:39.706376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebe5830661244958587f7060517c117', 'request_id': 'req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:39.726774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebe5830661244958587f7060517c117', 'request_id': 'req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:39.750137 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] The token cache is being invalidate because project eebe5830661244958587f7060517c117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:39.750430 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:39.751105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2b59b4e2-f0fa-4cf8-8dcb-ef3e6f0c7249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:39.753464 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1344/2718] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:39 2022] DELETE /identity/v3/projects/eebe5830661244958587f7060517c117 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:39.758801 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.759295 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.759746 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.783159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:39.784482 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:39.873828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1375/2719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:39.881816 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335336c-642c-476d-805f-50378510bb7b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.882173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335336c-642c-476d-805f-50378510bb7b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.883161 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335336c-642c-476d-805f-50378510bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.901672 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3335336c-642c-476d-805f-50378510bb7b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:39.902872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3335336c-642c-476d-805f-50378510bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:39.911709 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1345/2720] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:39.915927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:39.925438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cc45b-a5b5-4492-8a44-2aaa5743baaa None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:39.930264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:39.930921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.931200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.931474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.932202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:21:39.932546 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:39.934151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:39.945595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1376/2721] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:21:39.952820 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335336c-642c-476d-805f-50378510bb7b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:39.962317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335336c-642c-476d-805f-50378510bb7b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:39.969132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:39.969776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:39.970023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:39.970287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:39.971040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:39.973119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:39.994959 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:40.020826 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1346/2722] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:39 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:40.024132 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.035903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.036503 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34429a2d-e326-4f87-a4da-de6df86ace8f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.038384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.097906 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.098674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.099057 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.099427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.100235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.102310 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.109717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ce631-ec15-4ca9-b2d8-e8f9b1d595a9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.114470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.115356 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.115641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.115900 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] PATH_INFO: `/v3/users/bb218ceeb8eb4955850daa843fe03add` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.117139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb218ceeb8eb4955850daa843fe03add)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.119045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.123702 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1377/2723] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:40.127748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.137069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df0d-9720-4a3d-acbd-87679199cd52 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.141661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.142312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.142579 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.142854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.143578 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.145212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.146650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:40.159782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1378/2724] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:40.161591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.175158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1758e-73a7-457e-9a83-c0b32996d29a admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.180855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.181038 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb218ceeb8eb4955850daa843fe03add'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.181541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.181814 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb218ceeb8eb4955850daa843fe03add'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.181959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.182087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.182683 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb218ceeb8eb4955850daa843fe03add'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.182809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.184417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.191029 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb218ceeb8eb4955850daa843fe03add'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.195850 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1379/2725] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:40.200724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ba0ec5ab-ed2c-4058-a513-c1190f1d3d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb218ceeb8eb4955850daa843fe03add'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.201388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.203456 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.217798 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa2a91-fc1c-4f09-90a2-4fe786e6efb0 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.224776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.225121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1347/2726] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:40 2022] DELETE /identity/v3/users/bb218ceeb8eb4955850daa843fe03add => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:40.226415 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.226862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.227284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] PATH_INFO: `/v3/projects/d04e4d89de134e9cbad92db3ef33cd17/users/9f1efb0d7ad44e5cb461513a9f092317/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.243901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04e4d89de134e9cbad92db3ef33cd17, user_id=9f1efb0d7ad44e5cb461513a9f092317, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.247074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.262925 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1380/2727] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:40 2022] PUT /identity/v3/projects/d04e4d89de134e9cbad92db3ef33cd17/users/9f1efb0d7ad44e5cb461513a9f092317/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:40.273926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.274223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.275213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.307943 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] MFA Rules not processed for user `9f1efb0d7ad44e5cb461513a9f092317`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:40.309236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.374789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1348/2728] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:40.379537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.406960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.408518 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.414625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:40.452816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7e914-0a44-4864-9001-675b9a903cc5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.457407 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.458070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.458381 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.458655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.459366 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.461306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.487230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1381/2729] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:40.488194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaea9f2-bffd-454c-ad3a-0df7caa6ef4b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.492682 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.543762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.544779 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.545071 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.545377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] PATH_INFO: `/v3/projects/470d86bb3a034660aba1d1d1a768b718` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.546584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470d86bb3a034660aba1d1d1a768b718)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.548564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.552252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19161d2-f62a-4a8b-b464-6334a555eb1f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.557217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.557880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.558164 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.558451 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.559116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.561113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.582270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1382/2730] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:40.586300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.595895 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bac3-f977-4864-883b-a45e3768b580 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.597675 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470d86bb3a034660aba1d1d1a768b718', 'request_id': 'req-afbad8a1-0c18-468e-9f1a-b6e350b516d3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.603291 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470d86bb3a034660aba1d1d1a768b718', 'request_id': 'req-afbad8a1-0c18-468e-9f1a-b6e350b516d3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.611786 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470d86bb3a034660aba1d1d1a768b718', 'request_id': 'req-afbad8a1-0c18-468e-9f1a-b6e350b516d3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.623742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] The token cache is being invalidate because project 470d86bb3a034660aba1d1d1a768b718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:40.624026 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.624688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-afbad8a1-0c18-468e-9f1a-b6e350b516d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:40.626247 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1349/2731] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:40 2022] DELETE /identity/v3/projects/470d86bb3a034660aba1d1d1a768b718 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:21:40.631009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccdee4-40a3-4c5d-8749-ea18c2db1f11 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.631232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccdee4-40a3-4c5d-8749-ea18c2db1f11 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.631508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccdee4-40a3-4c5d-8749-ea18c2db1f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.632235 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:40.649871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c7ccdee4-40a3-4c5d-8749-ea18c2db1f11 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:40.651108 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c7ccdee4-40a3-4c5d-8749-ea18c2db1f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.657577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.658248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.658525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.658796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.659559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.661191 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.670926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1383/2732] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:40.674894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.676542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.686201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:40.689732 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3f11-9e2a-4b01-8060-fe8a05ef8acd admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.694647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.695309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.695585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.695885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.696626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.698221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.709099 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1384/2733] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:40.713098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.713892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1350/2734] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:40.721546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.721813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.722090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.723158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9aab-0a68-424f-b928-4077d0565422 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.727630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.728527 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.728807 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.729080 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] PATH_INFO: `/v3/projects/bfd6be002df24c0c8669b8b688018eb0/users/8ae8672cb8ff4f06b26253e22597ed0b/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.740690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:40.741870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.743930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd6be002df24c0c8669b8b688018eb0, user_id=8ae8672cb8ff4f06b26253e22597ed0b, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.746583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af3fc5-7b8a-4bb3-9900-0dd7c84366c7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.750611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1351/2735] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:40.755210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.759714 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1385/2736] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:40 2022] PUT /identity/v3/projects/bfd6be002df24c0c8669b8b688018eb0/users/8ae8672cb8ff4f06b26253e22597ed0b/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:21:40.764770 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96990ee-62fe-49da-9eab-937d903afebd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.770891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.771174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.771443 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.798161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] MFA Rules not processed for user `8ae8672cb8ff4f06b26253e22597ed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:40.799375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:40.823050 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.823722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.823999 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.824276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.825043 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:21:40.825348 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.827012 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.841564 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1352/2737] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:21:40.842514 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.852559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20aeef-4a65-43df-99f4-57dc8f0e07b7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.857706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.858341 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.858617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.858894 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.859560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.861485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.863655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1386/2738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:40.868038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.878030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5ce4d-4c04-4e2d-baff-837aa2f2be5c None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.882764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.883359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.883643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.883923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.884654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.886559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.891531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1353/2739] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:21:40.892589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.918031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1387/2740] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:21:40.919116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:40.956360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83244-1035-4ed4-a763-503a9cc72bca admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.978240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66293-29c8-4fc9-9888-9a94be9cb8be admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:40.983017 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:40.983681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:40.983960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:40.984232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:40.984952 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:40.986901 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:40.995517 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:41.005741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:41.011552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1388/2741] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:41.012676 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.019413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.020103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.020394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.020737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.021431 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.023451 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.023752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe988e-34bb-432a-b86c-1f333fc058ab admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.028251 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.028933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.029221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.029524 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.030250 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.031880 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.042237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1389/2742] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:41.043917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1354/2743] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:40 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:21:41.046844 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.047572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.057094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134299b8-8066-45e4-92e9-601686b16a6f admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.057394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9d21-8f65-4bf4-b2b1-2df6424cc252 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.061870 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.062002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.062519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.062801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.062918 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.063077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.063180 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.063449 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] PATH_INFO: `/v3/projects/7bec553f87a24b95849aea77ef7ffff3/users/e76581b42dbe471085e43747e03e0b40/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.063796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.065484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.076383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1355/2744] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:41.078377 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bec553f87a24b95849aea77ef7ffff3, user_id=e76581b42dbe471085e43747e03e0b40, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.080419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.081112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.090639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bbc8-999e-4d4e-b980-1aa7c6e5df50 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.095782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1390/2745] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:41 2022] PUT /identity/v3/projects/7bec553f87a24b95849aea77ef7ffff3/users/e76581b42dbe471085e43747e03e0b40/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:41.099645 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.147150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.147747 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.148034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.148315 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.149090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.150749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.160988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1356/2746] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:41.163416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfa52-04c1-417c-8668-8ac24a4bdb2d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.165366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.168651 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.169484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.169836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.170144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.171185 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.173484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.176873 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb003b-b7c7-4c2c-9eda-92b04d550c0d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.183300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.184309 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.184927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.185061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1391/2747] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:21:41.185162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] PATH_INFO: `/v3/projects/6fbd445d64d241f78de9f4edb5f2d652/users/452fc6e7f5344a72a47db0ca01573e00/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.189241 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.199240 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8062f3-dbfb-48fc-8923-82e86629efee admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.202401 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbd445d64d241f78de9f4edb5f2d652, user_id=452fc6e7f5344a72a47db0ca01573e00, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.203864 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.204794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.205074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.205199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733705d5-009e-4548-b6dc-917692ceed57 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.205353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] PATH_INFO: `/v3/projects/7bec553f87a24b95849aea77ef7ffff3/users/e76581b42dbe471085e43747e03e0b40/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.207531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bec553f87a24b95849aea77ef7ffff3, user_id=e76581b42dbe471085e43747e03e0b40, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.210421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c8bcd-730e-443c-930a-0ccb66472d89 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.220357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1357/2748] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:41 2022] PUT /identity/v3/projects/6fbd445d64d241f78de9f4edb5f2d652/users/452fc6e7f5344a72a47db0ca01573e00/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:41.225046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1392/2749] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:41 2022] PUT /identity/v3/projects/7bec553f87a24b95849aea77ef7ffff3/users/e76581b42dbe471085e43747e03e0b40/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:21:41.225517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.225855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.226131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.234902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.235190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.235466 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.242979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:41.244185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:41.262309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] MFA Rules not processed for user `e76581b42dbe471085e43747e03e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:41.263550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:41.301699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1358/2750] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:41.311901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.313323 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:41.335103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1393/2751] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:21:41.346855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:41.348259 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:41.359853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:41.371551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8cfb-3057-406a-a38d-51805945e039 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.375383 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.376037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.376394 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.376804 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.379995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:41.387584 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.389445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.399966 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1359/2752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:21:41.409206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd53d-6963-4ba4-8280-15fe3e5f62d6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:41.412756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:41.413412 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:41.413693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:41.413956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:41.415731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:41.481796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:41.483859 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:41.495605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1394/2753] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:21:43.044196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:43.045661 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:43.061813 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeca49-12d5-4d37-ba9b-7c3325d85bdb service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:43.066197 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:43.067077 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:43.067776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:43.068233 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:43.137493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:43.139142 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef232115-c33c-48a7-8190-62bfbac34693 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:43.149232 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1360/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:43.736878 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:43.745910 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183325-c206-43cd-923e-439d085ae448 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:43.749720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:43.750387 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:43.750662 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:43.750934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:43.762042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:43.763300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:43.775324 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1395/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:46.005941 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28944f-258c-414b-9cfb-c07ebe3f294c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:46.006439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28944f-258c-414b-9cfb-c07ebe3f294c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:46.006643 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28944f-258c-414b-9cfb-c07ebe3f294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:46.037614 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8e28944f-258c-414b-9cfb-c07ebe3f294c None None] MFA Rules not processed for user `452fc6e7f5344a72a47db0ca01573e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:46.038834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8e28944f-258c-414b-9cfb-c07ebe3f294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:46.108789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1361/2756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:46.123427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:46.124999 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:46.207731 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1633bd-72b6-4612-9e27-61e0182900ec service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:46.213408 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:46.214518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:46.214863 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:46.215215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:46.224411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:46.226139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:46.237995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1396/2757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:47.614040 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8313d-a84a-4743-9cd5-ff1a99aa8aad None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:47.614625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8313d-a84a-4743-9cd5-ff1a99aa8aad None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:47.614877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8313d-a84a-4743-9cd5-ff1a99aa8aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:47.632102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-97e8313d-a84a-4743-9cd5-ff1a99aa8aad None None] MFA Rules not processed for user `452fc6e7f5344a72a47db0ca01573e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:47.633335 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-97e8313d-a84a-4743-9cd5-ff1a99aa8aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:47.640742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1362/2758] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:47.811033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:47.822428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e8114-398f-44a4-9139-2927c0cf328b service nova] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:47.827094 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:47.827995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:47.828280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:47.828598 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] PATH_INFO: `/v3/users/9f1efb0d7ad44e5cb461513a9f092317` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:47.829805 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1efb0d7ad44e5cb461513a9f092317)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:47.831756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:47.882756 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1efb0d7ad44e5cb461513a9f092317'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:47.883892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1efb0d7ad44e5cb461513a9f092317'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:47.884528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1efb0d7ad44e5cb461513a9f092317'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:47.888831 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:47.901116 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1efb0d7ad44e5cb461513a9f092317'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:47.912638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1efb0d7ad44e5cb461513a9f092317'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:47.950625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1397/2759] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:47 2022] DELETE /identity/v3/users/9f1efb0d7ad44e5cb461513a9f092317 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:47.951546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:47.951839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:47.952128 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:47.976258 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:47.977968 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:48.059741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1363/2760] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:48.070384 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:48.072158 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:48.191887 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c02d8-a040-4c1b-bd81-44ef5b341675 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:48.204281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:48.205189 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:48.205650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:48.206098 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:48.221193 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:48.223074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:48.248561 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1398/2761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:21:48.799055 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:48.800964 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:48.827855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09c23-40b0-45ba-99a0-6f81ebef0779 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:48.833877 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:48.834784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:48.835065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:48.835520 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] PATH_INFO: `/v3/projects/d04e4d89de134e9cbad92db3ef33cd17` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:48.836824 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04e4d89de134e9cbad92db3ef33cd17)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:48.838920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:48.843158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=100 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:48.942088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04e4d89de134e9cbad92db3ef33cd17', 'request_id': 'req-a0e5165b-8b56-4875-929f-42d251f05b28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:48.949455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04e4d89de134e9cbad92db3ef33cd17', 'request_id': 'req-a0e5165b-8b56-4875-929f-42d251f05b28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:48.962942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04e4d89de134e9cbad92db3ef33cd17', 'request_id': 'req-a0e5165b-8b56-4875-929f-42d251f05b28'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:48.978720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] The token cache is being invalidate because project d04e4d89de134e9cbad92db3ef33cd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:48.979176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:48.980218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:48.985755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1364/2762] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:48 2022] DELETE /identity/v3/projects/d04e4d89de134e9cbad92db3ef33cd17 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:48.987030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:48.999276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5145-cd98-47e4-9df2-7e416bf8b36f service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:49.069518 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:49.070424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:49.070707 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:49.070982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] PATH_INFO: `/v3/users/8ae8672cb8ff4f06b26253e22597ed0b` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:49.072195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae8672cb8ff4f06b26253e22597ed0b)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:49.074170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:49.131267 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae8672cb8ff4f06b26253e22597ed0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.131928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae8672cb8ff4f06b26253e22597ed0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.132574 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae8672cb8ff4f06b26253e22597ed0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.140398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae8672cb8ff4f06b26253e22597ed0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.149670 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae8672cb8ff4f06b26253e22597ed0b'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.156076 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:49.173903 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1399/2763] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:48 2022] DELETE /identity/v3/users/8ae8672cb8ff4f06b26253e22597ed0b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:49.491793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:49.493572 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:49.516993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5165b-8b56-4875-929f-42d251f05b28 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:49.587692 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:49.588733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:49.589016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:49.589991 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] PATH_INFO: `/v3/projects/bfd6be002df24c0c8669b8b688018eb0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:49.591340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd6be002df24c0c8669b8b688018eb0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:49.594641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:49.652581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd6be002df24c0c8669b8b688018eb0', 'request_id': 'req-50e3709e-dd18-40dc-a688-957736c517f6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.659006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd6be002df24c0c8669b8b688018eb0', 'request_id': 'req-50e3709e-dd18-40dc-a688-957736c517f6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.667096 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd6be002df24c0c8669b8b688018eb0', 'request_id': 'req-50e3709e-dd18-40dc-a688-957736c517f6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.679888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] The token cache is being invalidate because project bfd6be002df24c0c8669b8b688018eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:49.680272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.681019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.682748 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1365/2764] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:49 2022] DELETE /identity/v3/projects/bfd6be002df24c0c8669b8b688018eb0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:49.687224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:49.688748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:49.702823 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5632-2e78-464c-ae8f-ba15d8fba5ff admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:49.760869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:49.761790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:49.762070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:49.762998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] PATH_INFO: `/v3/users/e76581b42dbe471085e43747e03e0b40` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:49.764399 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76581b42dbe471085e43747e03e0b40)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:49.766365 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:49.815951 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76581b42dbe471085e43747e03e0b40'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.816675 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76581b42dbe471085e43747e03e0b40'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.817261 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76581b42dbe471085e43747e03e0b40'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.824877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76581b42dbe471085e43747e03e0b40'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.834087 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-e987568b-d10a-43c7-bc2e-60b4c912c09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76581b42dbe471085e43747e03e0b40'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:49.851444 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1400/2765] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:21:49 2022] DELETE /identity/v3/users/e76581b42dbe471085e43747e03e0b40 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:50.185259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.186910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:50.200439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3709e-dd18-40dc-a688-957736c517f6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.225075 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:50.281494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.282375 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.282653 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.282926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] PATH_INFO: `/v3/projects/7bec553f87a24b95849aea77ef7ffff3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.284105 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bec553f87a24b95849aea77ef7ffff3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.286084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.333761 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bec553f87a24b95849aea77ef7ffff3', 'request_id': 'req-f2587c6d-35d2-4500-8555-8b99fbcd804c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:50.339089 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bec553f87a24b95849aea77ef7ffff3', 'request_id': 'req-f2587c6d-35d2-4500-8555-8b99fbcd804c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:50.347477 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bec553f87a24b95849aea77ef7ffff3', 'request_id': 'req-f2587c6d-35d2-4500-8555-8b99fbcd804c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:50.360690 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] The token cache is being invalidate because project 7bec553f87a24b95849aea77ef7ffff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:21:50.360982 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:50.361629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f2587c6d-35d2-4500-8555-8b99fbcd804c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:21:50.363462 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1366/2766] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:21:50 2022] DELETE /identity/v3/projects/7bec553f87a24b95849aea77ef7ffff3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:50.368245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.368785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.368891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.388126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:50.389763 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:50.451728 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1401/2767] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:50.460507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.460720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.461002 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.484422 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:50.485722 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:50.493902 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1367/2768] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:50.498469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.508311 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d681-c363-45a5-883c-0eedffad89cf None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.513137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.513897 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.514172 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.514442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.515192 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:21:50.515491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.517135 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.518936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:50.534609 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1402/2769] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:21:50.535997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.545855 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed189e-cf19-4a74-8d2a-ecd46a09f29a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.551293 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.551956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.552266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.552928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.553622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.555531 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.583623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1368/2770] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:21:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:50.588247 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.598852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3849-d252-48fd-b313-924cb571768b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.656272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.657075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.657361 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.657643 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.658333 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.660260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.681893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1403/2771] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:21:50 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:21:50.686058 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.696623 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f2d9f-860d-4e77-9156-21b39bdcf0e3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.701548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.702223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.702508 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.702789 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.703526 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.705234 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.719175 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1369/2772] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:50.720351 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.730505 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767521-54b4-4300-a078-254cf5b35074 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.735262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.735926 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.736205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.736507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.737234 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.738836 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1439a9-b79e-4724-95e5-927602cce24e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.748920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1404/2773] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:21:50.753645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.763880 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e87b1-e9a8-4220-8112-fc50cb763508 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:50.768983 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:50.769907 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.770190 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.770468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] PATH_INFO: `/v3/projects/c484608d59454002b51902f8eb333207/users/0b8adf18c0664792816caf82dae309dc/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.786519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c484608d59454002b51902f8eb333207, user_id=0b8adf18c0664792816caf82dae309dc, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:50.789353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:50.807057 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1370/2774] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:21:50 2022] PUT /identity/v3/projects/c484608d59454002b51902f8eb333207/users/0b8adf18c0664792816caf82dae309dc/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:21:50.876637 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:50.876923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:50.877201 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:50.906804 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] MFA Rules not processed for user `0b8adf18c0664792816caf82dae309dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:21:50.907755 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:50.980049 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1405/2775] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:21:50.994432 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:21:50.997034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:21:51.061117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:21:51.065367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396647af-89fc-4ba4-9667-9dc3c3487b30 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:21:51.071122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:21:51.072178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:21:51.072573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:21:51.072885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:21:51.083395 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:21:51.085018 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe089b-d4ef-44bc-a617-a112b4296a98 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:21:51.095784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1371/2776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:00.933785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.001493 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2abbd-d1c1-446c-a25d-d1ea69d9cb12 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.006224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.007067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.007371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.007642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] PATH_INFO: `/v3/users/0b8adf18c0664792816caf82dae309dc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.008869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8adf18c0664792816caf82dae309dc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.010787 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:01.013398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:01.065712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8adf18c0664792816caf82dae309dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.066354 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8adf18c0664792816caf82dae309dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.066959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8adf18c0664792816caf82dae309dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.073810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8adf18c0664792816caf82dae309dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.082872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8adf18c0664792816caf82dae309dc'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.090445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=4 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:01.102474 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1406/2777] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:22:00 2022] DELETE /identity/v3/users/0b8adf18c0664792816caf82dae309dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:22:01.107146 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.107505 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.107888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.126254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:01.127456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:01.190235 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1372/2778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:01.200563 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.202070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:01.261422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810aa3c-9275-42e3-869e-79afc976d0a5 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.265410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.266072 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.266357 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.266635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.276571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.278033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b4a1-aab3-49ff-b3b4-ba72c3f98416 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:01.288031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1407/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:22:01.571963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.573607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:01.586723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b829a-6d4e-464c-94d1-c42910f2421b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.591714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.593283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.593283 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.593485 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] PATH_INFO: `/v3/projects/c484608d59454002b51902f8eb333207` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.594863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c484608d59454002b51902f8eb333207)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.597116 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:01.645782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c484608d59454002b51902f8eb333207', 'request_id': 'req-d1456043-483a-4288-bda3-9ebf3bb54b10'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.652084 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c484608d59454002b51902f8eb333207', 'request_id': 'req-d1456043-483a-4288-bda3-9ebf3bb54b10'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.661456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c484608d59454002b51902f8eb333207', 'request_id': 'req-d1456043-483a-4288-bda3-9ebf3bb54b10'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.674032 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] The token cache is being invalidate because project c484608d59454002b51902f8eb333207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:22:01.674322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.674967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d1456043-483a-4288-bda3-9ebf3bb54b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:22:01.676593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1373/2780] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:22:01 2022] DELETE /identity/v3/projects/c484608d59454002b51902f8eb333207 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:22:01.681966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66353-320c-46db-804d-00322b7e75be None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.682362 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66353-320c-46db-804d-00322b7e75be None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.682699 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66353-320c-46db-804d-00322b7e75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.700217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ded66353-320c-46db-804d-00322b7e75be None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:01.701445 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ded66353-320c-46db-804d-00322b7e75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:01.760131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1408/2781] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:01.768224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.768470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.768758 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.787227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:01.788496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:01.797132 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1374/2782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:01.801398 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66353-320c-46db-804d-00322b7e75be None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.811538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66353-320c-46db-804d-00322b7e75be None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.816254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.816937 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.817221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.817481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.818221 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:22:01.818525 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.820133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:01.831828 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1409/2783] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:22:01.838103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.847871 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc42e59-1c5d-4b89-bf00-623fc18de6d2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.853332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.854199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.854482 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.854741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.855428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.857588 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:01.897159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1375/2784] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:22:01 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:22:01.901606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:01.913119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd70a6c-947f-4447-b08c-071257006187 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:01.921219 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:01.976174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:01.977664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:01.978279 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:01.978560 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:01.979417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:01.981446 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:02.005472 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1410/2785] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:22:01 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:22:02.009965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:02.021083 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a9cf3-4143-4984-a1b3-f9cf586c9f51 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:02.025819 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:02.026607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:02.027360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:02.027360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:02.028214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:02.029950 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:02.045253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1376/2786] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:22:02.047127 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:02.058167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4babe7-64ab-4547-aad2-33b9aa49308b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:02.064173 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:02.065045 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:02.065433 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:02.065812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:02.066648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:02.068631 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cca125-83b0-4404-a4f5-9346d1c2568f admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:02.083037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1411/2787] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:22:02.084700 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:02.099387 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e6ba6-4568-43c7-b434-821018fb1bba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:02.105178 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:02.106470 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:02.106995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:02.107494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] PATH_INFO: `/v3/projects/41e1db2fed4d42c5b4c47a048c27d167/users/244471c15e1140908797e20bc2e40d59/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:02.128419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e1db2fed4d42c5b4c47a048c27d167, user_id=244471c15e1140908797e20bc2e40d59, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:02.131648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:02.150594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1377/2788] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:22:02 2022] PUT /identity/v3/projects/41e1db2fed4d42c5b4c47a048c27d167/users/244471c15e1140908797e20bc2e40d59/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:22:02.156063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764547-52b2-4fe5-b314-be41458132e2 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:02.156748 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764547-52b2-4fe5-b314-be41458132e2 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:02.157216 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764547-52b2-4fe5-b314-be41458132e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:02.178202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c8764547-52b2-4fe5-b314-be41458132e2 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:02.179565 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c8764547-52b2-4fe5-b314-be41458132e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:02.247790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1412/2789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:22:02.259630 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:02.261617 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:02.286926 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:02.329976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d22a3-3efc-4ce3-9621-98238ef28f0b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:02.334176 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:02.335099 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:02.335391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:02.335669 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:02.346184 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:02.347829 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:02.361440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1378/2790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:06.298771 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.299300 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.299401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.325970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] MFA Rules not processed for user `244471c15e1140908797e20bc2e40d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:06.327177 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:06.415465 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1413/2791] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:06.420342 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.431659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62853-c7cc-4ded-b2fa-4b0246f50393 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.437020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.437822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.438164 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.438532 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.439325 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.441343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.470610 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1379/2792] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:22:06 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:22:06.474790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.488535 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba6fc-9876-4782-ba9f-522f6779e825 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.506046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:06.571166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.571849 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.572129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.572401 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.573159 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.575065 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.597605 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1414/2793] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:22:06 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:22:06.602317 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.614405 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e528c2f-e733-4ebf-b8b0-c0e6c460e246 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.619223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.619915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.620209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.620519 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.621266 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.622903 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.634793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1380/2794] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:22:06.639044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.650749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ca59-2301-4dd8-84e5-4fc4f32dfd71 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.655914 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.656960 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.657312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.657656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] PATH_INFO: `/v3/projects/19658ee75ca0466d80675ab6c82ac15c/users/04afbd569f4247f39b2a549418ac14e2/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.674890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19658ee75ca0466d80675ab6c82ac15c, user_id=04afbd569f4247f39b2a549418ac14e2, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.677995 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.692800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1415/2795] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:22:06 2022] PUT /identity/v3/projects/19658ee75ca0466d80675ab6c82ac15c/users/04afbd569f4247f39b2a549418ac14e2/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:22:06.696837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.707254 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2641d1-5f90-468f-b115-751869fc802e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.767199 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.768013 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.768301 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.768607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.769340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.770958 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a668d-2e00-41a5-8ee6-69dfe77f98a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.781939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1381/2796] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:22:06.786353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:06.797232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee997-b6c1-4b6d-8e5f-936f103960bc admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:06.802248 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:06.803155 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:06.803628 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:06.803860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] PATH_INFO: `/v3/projects/19658ee75ca0466d80675ab6c82ac15c/users/04afbd569f4247f39b2a549418ac14e2/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:06.805891 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19658ee75ca0466d80675ab6c82ac15c, user_id=04afbd569f4247f39b2a549418ac14e2, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:06.808622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:06.819973 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1416/2797] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:22:06 2022] PUT /identity/v3/projects/19658ee75ca0466d80675ab6c82ac15c/users/04afbd569f4247f39b2a549418ac14e2/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:22:11.090397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22603-5100-4dce-b1c9-22c0c3ac94b4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:11.090969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22603-5100-4dce-b1c9-22c0c3ac94b4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:11.090969 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22603-5100-4dce-b1c9-22c0c3ac94b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:11.117831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-58c22603-5100-4dce-b1c9-22c0c3ac94b4 None None] MFA Rules not processed for user `04afbd569f4247f39b2a549418ac14e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:11.119130 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-58c22603-5100-4dce-b1c9-22c0c3ac94b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:11.193881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1382/2798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:11.206487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:11.208330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:11.266328 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eef37e-1e9c-414f-bec0-56ff25ba70b7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:11.270110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:11.270751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:11.271052 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:11.271326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:11.329752 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:11.331217 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:11.341070 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1417/2799] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:11.441491 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49235-bbaa-4928-9da8-6a08f41735a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:11.441754 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49235-bbaa-4928-9da8-6a08f41735a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:11.442035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49235-bbaa-4928-9da8-6a08f41735a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:11.461410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d8c49235-bbaa-4928-9da8-6a08f41735a6 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:11.462622 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8c49235-bbaa-4928-9da8-6a08f41735a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:11.471751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:11.529688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1383/2800] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:11.579736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:11.581316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:11.616655 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:11.661495 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb505-427d-46dc-9e3a-9a598e97b0d1 service glance] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:11.666871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:11.667616 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:11.667902 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:11.668188 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:11.677484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:11.679079 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:11.687262 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1418/2801] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:22:20.288122 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d04d7-1ddb-4d94-815b-d7d6c40a0ef1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:20.288704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d04d7-1ddb-4d94-815b-d7d6c40a0ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:20.288704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d04d7-1ddb-4d94-815b-d7d6c40a0ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:20.306782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dc2d04d7-1ddb-4d94-815b-d7d6c40a0ef1 None None] MFA Rules not processed for user `244471c15e1140908797e20bc2e40d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:20.307974 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dc2d04d7-1ddb-4d94-815b-d7d6c40a0ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:20.315078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1384/2802] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:20.578476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:20.580063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:20.647586 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3864110-f303-474a-a0b2-96d4bd8ebd5f service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:20.651915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:20.652592 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:20.652871 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:20.653119 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:20.655133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:20.665559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:20.667001 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:20.675712 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1419/2803] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:23.308874 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:23.309381 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:23.309484 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:23.327063 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:22:23.328246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:23.335448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1385/2804] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 5 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:22:23.349128 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:23.361532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085968f-892b-42d5-ae71-ad5c7939d5c7 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:23.366522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:23.367183 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:23.367464 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:23.367742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:23.376342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:23.377975 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:23.386229 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1420/2805] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:22:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:22:33.322078 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=26 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:33.382905 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=52 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:44.413103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:44.424391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3454f3-d56b-46f5-8acc-2093fd491e89 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:44.429502 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:44.430236 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:44.430517 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:44.430788 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:44.432927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:44.514174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:44.515631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:44.526787 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1386/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:49.635190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:49.649796 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93ef4-0e89-44cd-8bfd-d4902804f158 service swift] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:49.654380 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:49.654976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:49.655255 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:49.655532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:49.657624 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:22:49.672165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:49.673687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2b665-8191-4b5f-94c6-d2b861c7a771 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:49.685939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1421/2807] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:49.815004 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:22:49.826603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1e6e4-0729-424a-a774-8cf4b54d952f service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:22:49.831188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:22:49.831867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:22:49.832149 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:22:49.832424 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:22:49.842300 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:22:49.843739 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:22:49.853483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1387/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:22:59.680663 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:59.849357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=40 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:22.482314 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:23:22.482879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:23:22.482879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:23:22.501131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] MFA Rules not processed for user `452fc6e7f5344a72a47db0ca01573e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:23:22.502350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:23:22.561622 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1422/2809] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:23:32.553723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=25 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:35.755741 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:23:35.757267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:23:35.773370 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4310de-98d1-428a-86d1-60c98f1d695b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:23:35.779133 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:23:35.779798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:23:35.780081 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:23:35.780365 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:23:35.782721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:23:35.795538 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:23:35.797188 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:23:35.808790 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1388/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:23:42.670691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:23:42.686036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdab65-ecb3-48e3-989d-bf780c6607bb None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:23:42.690650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:23:42.691372 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:23:42.691630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:23:42.691922 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:23:42.694150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:23:42.705143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:23:42.706674 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0e8b-6922-4dfd-abae-715b24da7238 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:23:42.715571 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1423/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:23:45.804158 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:52.712230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=6 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:24:53.896385 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:24:53.898324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:24:53.914268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bcd41-2163-4038-a027-ac39c06d9e27 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:24:53.920079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:24:53.920834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:24:53.921064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:24:53.921343 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:24:53.924005 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:24:53.938647 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:24:53.940269 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:24:53.953065 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1389/2812] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:24:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:25:02.624144 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:02.624701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:02.624701 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:02.643522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] MFA Rules not processed for user `452fc6e7f5344a72a47db0ca01573e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:25:02.644817 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:02.652800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1424/2813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:25:03.306091 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:03.307548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:03.392568 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33208-3e79-4eb5-b7a6-857f09a55f06 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:03.398030 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:03.398730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:03.399007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:03.399281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:03.401143 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:03.419808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:03.422772 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:03.435590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1390/2814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:25:10.924947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:10.939678 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8b6-6efb-4a28-aa98-9e2ed583edb8 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:10.945626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:10.946326 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:10.946673 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:10.946958 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:10.948980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:10.961860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:10.963467 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66fa3-dbd6-4286-9507-bba64667df8c service nova] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:10.974842 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1425/2815] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:25:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:25:13.431367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=38 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:20.969933 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=9 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:24.091597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:24.117353 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c750-b5ca-4297-be28-b3c665f05ea5 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:24.121567 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:24.122213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:24.122504 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:24.122784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:24.124798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:24.212962 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:24.214413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:24.224607 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1391/2816] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:25:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:25:29.812360 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:29.812858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:29.812966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:29.831610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] MFA Rules not processed for user `cfc40069aff94b77a542e3c02eea4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:25:29.832970 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:29.857606 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1426/2817] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 5 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:25:29.901224 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:29.921397 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ac96-cd9c-490c-a64f-a3dee9b7f50a service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:29.927281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0eaf162fd3647a0963e00de33419559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:29.927923 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:29.928205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:29.928503 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:29.937303 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:29.938890 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:29.949641 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1392/2818] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 5 16:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 16:25:30.423403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:30.436536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadc025-0177-427a-b6ed-bf363cc89c90 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:30.440749 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:30.441542 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:30.441915 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:30.442306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:30.444350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:30.548336 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:30.551720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:30.572792 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1427/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:25:37.593562 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:37.595784 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:37.613201 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fea80-c3ee-414c-bb7a-f4a1cd44d1f4 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:37.617659 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:37.637475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32aa3-58de-41ab-a71e-5d04dfb10c60 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:37.640521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:37.641440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:37.641728 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:37.642007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] PATH_INFO: `/v3/users/94b873bd2b4d41289d59668728ec644f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:37.648559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b873bd2b4d41289d59668728ec644f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:37.651163 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:37.651340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:37.652538 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:37.653042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:37.654023 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] PATH_INFO: `/v3/users/244471c15e1140908797e20bc2e40d59` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:37.655559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=244471c15e1140908797e20bc2e40d59)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:37.657539 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:37.720695 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b873bd2b4d41289d59668728ec644f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.721373 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b873bd2b4d41289d59668728ec644f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.721998 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b873bd2b4d41289d59668728ec644f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.729797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b873bd2b4d41289d59668728ec644f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.739153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244471c15e1140908797e20bc2e40d59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.740034 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244471c15e1140908797e20bc2e40d59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.740777 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244471c15e1140908797e20bc2e40d59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.742651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b873bd2b4d41289d59668728ec644f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.749181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244471c15e1140908797e20bc2e40d59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.760656 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244471c15e1140908797e20bc2e40d59'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:37.767965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1393/2820] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:25:37 2022] DELETE /identity/v3/users/94b873bd2b4d41289d59668728ec644f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:25:37.784396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1428/2821] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:25:37 2022] DELETE /identity/v3/users/244471c15e1140908797e20bc2e40d59 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:25:37.961688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:37.964001 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:37.984491 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:37.986022 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:37.993019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:38.015025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:38.046102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6b80-b092-4999-9791-6cfd03fcc45d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.067531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7b581-2881-4ede-9d03-6df1beadb6cb admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.072232 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.073118 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.073396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.073671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] PATH_INFO: `/v3/projects/41e1db2fed4d42c5b4c47a048c27d167` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.074867 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e1db2fed4d42c5b4c47a048c27d167)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.076810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.103561 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.104490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.105187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.105468 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] PATH_INFO: `/v3/projects/6353d67cb8cb4be0aa7dc1936cbbf04a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.106977 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6353d67cb8cb4be0aa7dc1936cbbf04a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.108986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.128697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e1db2fed4d42c5b4c47a048c27d167', 'request_id': 'req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.135036 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e1db2fed4d42c5b4c47a048c27d167', 'request_id': 'req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.140818 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e1db2fed4d42c5b4c47a048c27d167', 'request_id': 'req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.153930 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] The token cache is being invalidate because project 41e1db2fed4d42c5b4c47a048c27d167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:25:38.154304 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.154839 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.159455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1429/2822] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:25:37 2022] DELETE /identity/v3/projects/41e1db2fed4d42c5b4c47a048c27d167 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:25:38.159634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6353d67cb8cb4be0aa7dc1936cbbf04a', 'request_id': 'req-854e4f57-1faa-476a-a870-db5bc2c4090a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.160320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:38.161650 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:38.165339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6353d67cb8cb4be0aa7dc1936cbbf04a', 'request_id': 'req-854e4f57-1faa-476a-a870-db5bc2c4090a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.173581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6353d67cb8cb4be0aa7dc1936cbbf04a', 'request_id': 'req-854e4f57-1faa-476a-a870-db5bc2c4090a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.184769 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] The token cache is being invalidate because project 6353d67cb8cb4be0aa7dc1936cbbf04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:25:38.185060 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.185723 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.187320 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1394/2823] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:25:37 2022] DELETE /identity/v3/projects/6353d67cb8cb4be0aa7dc1936cbbf04a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:25:38.191118 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:38.192409 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:38.228254 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05a3e9-0665-4a9c-9e8c-0d3d2e0610e3 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.251445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:38.258225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4f57-1faa-476a-a870-db5bc2c4090a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.264121 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.265101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.265402 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.265673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] PATH_INFO: `/v3/users/0fbc403db84b4f7380a978fc45fdfbea` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.266881 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbc403db84b4f7380a978fc45fdfbea)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.268895 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.276260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:38.288046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.289042 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.289323 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.289602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] PATH_INFO: `/v3/users/04afbd569f4247f39b2a549418ac14e2` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.290810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=04afbd569f4247f39b2a549418ac14e2)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.292781 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.319887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbc403db84b4f7380a978fc45fdfbea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.320634 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbc403db84b4f7380a978fc45fdfbea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.321371 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbc403db84b4f7380a978fc45fdfbea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.328935 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbc403db84b4f7380a978fc45fdfbea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.336931 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbc403db84b4f7380a978fc45fdfbea'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.340281 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04afbd569f4247f39b2a549418ac14e2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.341097 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04afbd569f4247f39b2a549418ac14e2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.341724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04afbd569f4247f39b2a549418ac14e2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.353469 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04afbd569f4247f39b2a549418ac14e2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.356810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1395/2824] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:25:38 2022] DELETE /identity/v3/users/0fbc403db84b4f7380a978fc45fdfbea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:25:38.366038 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04afbd569f4247f39b2a549418ac14e2'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.395509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1430/2825] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:25:38 2022] DELETE /identity/v3/users/04afbd569f4247f39b2a549418ac14e2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:25:38.565554 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:38.567163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:38.605536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:25:38.606996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:25:38.640793 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff79b8-afe3-4b51-8c85-ca5d5f620f8b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.676418 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff573-a808-4526-87aa-6843b0dc2cea admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:25:38.681113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.682153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.682478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.682751 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] PATH_INFO: `/v3/projects/19658ee75ca0466d80675ab6c82ac15c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.684040 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] RBAC: Authorizing `identity:delete_project(project_id=19658ee75ca0466d80675ab6c82ac15c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.685993 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.699376 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:25:38.700274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:25:38.700593 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:25:38.700879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] PATH_INFO: `/v3/projects/e6dac3e8d4f14378a669edb0c1372e99` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:25:38.702090 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6dac3e8d4f14378a669edb0c1372e99)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:25:38.704008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:25:38.729776 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:38.735723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19658ee75ca0466d80675ab6c82ac15c', 'request_id': 'req-b4a717a5-d3ad-4362-aad0-7a3b27a287de'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.742764 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19658ee75ca0466d80675ab6c82ac15c', 'request_id': 'req-b4a717a5-d3ad-4362-aad0-7a3b27a287de'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.749025 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19658ee75ca0466d80675ab6c82ac15c', 'request_id': 'req-b4a717a5-d3ad-4362-aad0-7a3b27a287de'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.757036 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6dac3e8d4f14378a669edb0c1372e99', 'request_id': 'req-7730be4a-4dd0-4591-94fc-debf524f217c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.762499 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] The token cache is being invalidate because project 19658ee75ca0466d80675ab6c82ac15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:25:38.762986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.763549 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6dac3e8d4f14378a669edb0c1372e99', 'request_id': 'req-7730be4a-4dd0-4591-94fc-debf524f217c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.763684 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.765532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1431/2826] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:25:38 2022] DELETE /identity/v3/projects/19658ee75ca0466d80675ab6c82ac15c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:25:38.779721 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6dac3e8d4f14378a669edb0c1372e99', 'request_id': 'req-7730be4a-4dd0-4591-94fc-debf524f217c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.793639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] The token cache is being invalidate because project e6dac3e8d4f14378a669edb0c1372e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:25:38.793986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.794732 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7730be4a-4dd0-4591-94fc-debf524f217c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:25:38.796896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1396/2827] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:25:38 2022] DELETE /identity/v3/projects/e6dac3e8d4f14378a669edb0c1372e99 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:25:48.759717 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:48.789901 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:26:37.032634 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:26:37.034276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:37.140666 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a717a5-d3ad-4362-aad0-7a3b27a287de admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:26:37.201857 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:26:37.202435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:26:37.202720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:26:37.202972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:26:37.204920 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:37.216855 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:26:37.218454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:26:37.228393 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1432/2828] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:26:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:26:40.569170 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:26:40.569736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:26:40.569736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:26:40.590046 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] MFA Rules not processed for user `452fc6e7f5344a72a47db0ca01573e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:26:40.591255 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:40.645597 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1397/2829] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:26:40.954340 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:26:40.956031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:41.036966 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454676-e0c9-4df6-af47-fe74f5804155 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:26:41.044060 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:26:41.045043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:26:41.045396 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:26:41.045737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:26:41.048783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:41.059794 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:26:41.062610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:26:41.064706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:26:41.073224 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1433/2830] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:26:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:26:46.006413 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:26:46.008506 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:46.115206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b191c1-1420-46dc-9db6-8fc56f65506b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:26:46.121565 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:26:46.122215 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:26:46.122510 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:26:46.122782 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:26:46.124751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:26:46.135092 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:26:46.136749 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:26:46.145918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1398/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:26:51.069342 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=2 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:26:56.142073 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=68 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:27:58.524423 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:27:58.525944 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:27:58.625089 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d5b0d-fc77-4daf-a37f-0ced68d73f28 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:27:58.628929 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:27:58.629591 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:27:58.629876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:27:58.630151 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:27:58.631996 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:27:58.645783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:27:58.647389 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:27:58.658497 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1434/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:01.292411 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:01.304218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028034ad-0f0a-4382-a434-103aeaecc8b6 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:01.308364 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:01.309041 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:01.309360 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:01.309637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:01.311631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:01.325648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:01.327112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:01.338398 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1399/2833] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:08.653720 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=35 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:10.794526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:10.796113 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:10.808704 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553d7b-8c1c-4596-a5c0-7515c83057e1 service cinder] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:10.812936 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:10.813583 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:10.813872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:10.814146 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:10.816056 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:10.882141 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:10.883593 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:10.893783 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1435/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:11.333483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=6 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:13.776523 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:13.778112 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:13.794440 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9921eb-adf7-4cf6-ad2f-173aafef1767 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:13.800045 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:13.800801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:13.801163 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:13.801521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:13.803406 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:13.817875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:13.819810 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:13.830833 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1400/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:13.843800 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:13.845278 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:13.858816 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f176-d268-4ad6-a6b7-05d98302bea0 service neutron] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:13.863977 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:13.864979 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:13.865171 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:13.865441 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] PATH_INFO: `/v3/users/452fc6e7f5344a72a47db0ca01573e00` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:13.866635 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452fc6e7f5344a72a47db0ca01573e00)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:13.868657 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:13.921690 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452fc6e7f5344a72a47db0ca01573e00'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:13.922358 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452fc6e7f5344a72a47db0ca01573e00'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:13.922956 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452fc6e7f5344a72a47db0ca01573e00'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:13.930350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452fc6e7f5344a72a47db0ca01573e00'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:13.939083 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-f4d3eaf6-6857-498d-b844-9b6f319c7811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452fc6e7f5344a72a47db0ca01573e00'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:13.957545 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1436/2836] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:13 2022] DELETE /identity/v3/users/452fc6e7f5344a72a47db0ca01573e00 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:28:14.140727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.151867 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16be7c-98bf-46fa-95d3-d225bd572aef service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.209594 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.210388 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.210664 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.210934 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] PATH_INFO: `/v3/projects/6fbd445d64d241f78de9f4edb5f2d652` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.212103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbd445d64d241f78de9f4edb5f2d652)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.214082 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.264362 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbd445d64d241f78de9f4edb5f2d652', 'request_id': 'req-988a9100-dc0a-4065-83bd-21afb74e0627'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:14.270111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbd445d64d241f78de9f4edb5f2d652', 'request_id': 'req-988a9100-dc0a-4065-83bd-21afb74e0627'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:14.277226 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbd445d64d241f78de9f4edb5f2d652', 'request_id': 'req-988a9100-dc0a-4065-83bd-21afb74e0627'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:14.288627 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] The token cache is being invalidate because project 6fbd445d64d241f78de9f4edb5f2d652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:14.288917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:14.289666 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-988a9100-dc0a-4065-83bd-21afb74e0627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:14.291718 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1401/2837] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:14 2022] DELETE /identity/v3/projects/6fbd445d64d241f78de9f4edb5f2d652 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:14.297044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.297330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.297610 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.355095 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:14.356313 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:14.396149 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:14.427044 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1437/2838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:14.435448 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.435736 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.436008 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.455487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:14.456720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:14.466268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1402/2839] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:14.470421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.482982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bf53c-73a0-4691-bdd6-6aac8eaf5f41 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.489181 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.489876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.490156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.490431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.491207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:28:14.491515 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.493205 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.505945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1438/2840] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:28:14.510463 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.520580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd17f8-1211-428e-b8d6-0d61d52387fb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.525625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.526332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.526619 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.526896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.527581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.529592 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.557016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1403/2841] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:14.562108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.572414 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3e6ac-4887-476d-9e7d-f2e1050d7526 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.630198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.630879 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.631160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.631435 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.632154 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.634126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.657478 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1439/2842] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:14 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:28:14.661676 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.674875 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff79ad-a7a2-452c-a142-d4f6085d1b09 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.679863 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.680559 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.680840 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.681117 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.681843 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.683450 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.694551 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1404/2843] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:14.698778 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.710536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7d79-a2c7-4367-af0b-6f39e5f53972 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.715762 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.716427 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.716742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.717174 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.717793 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.719507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ae76c-af5c-48d0-9de2-762174043cdb admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.730272 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1440/2844] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:28:14.735177 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.751210 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355149e-4af8-407f-8efa-e4dd42a5c4ad admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:14.757443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:14.758366 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.758637 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.758928 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] PATH_INFO: `/v3/projects/1809ae9d3b4e42ba98be4300e8d20b5a/users/899d6063c8f84936b09a4b8b861a6a5a/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.775051 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809ae9d3b4e42ba98be4300e8d20b5a, user_id=899d6063c8f84936b09a4b8b861a6a5a, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:14.777699 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:14.794021 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1405/2845] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:14 2022] PUT /identity/v3/projects/1809ae9d3b4e42ba98be4300e8d20b5a/users/899d6063c8f84936b09a4b8b861a6a5a/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:14.808917 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:14.809212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:14.809600 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:14.836868 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] MFA Rules not processed for user `899d6063c8f84936b09a4b8b861a6a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:14.838139 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:14.913713 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1441/2846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:14.925704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:14.927791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:14.943945 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:15.005948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e17f-bc0b-4994-a8af-78b08907ca9b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:15.012153 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb2c2c6299946e1a172eb6948b28094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:15.012918 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:15.013202 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:15.013492 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:15.022571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:15.024181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1ab19-cfe8-4196-9974-6f7ce27978ca service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:15.033533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1406/2847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:17.723894 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:17.756371 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:17.787811 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93255-44d6-4652-80d2-083d36686820 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:17.792776 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:17.793648 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:17.793927 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:17.794203 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] PATH_INFO: `/v3/users/899d6063c8f84936b09a4b8b861a6a5a` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:17.795394 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899d6063c8f84936b09a4b8b861a6a5a)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:17.797348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:17.847832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899d6063c8f84936b09a4b8b861a6a5a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:17.848531 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899d6063c8f84936b09a4b8b861a6a5a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:17.849195 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899d6063c8f84936b09a4b8b861a6a5a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:17.856075 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899d6063c8f84936b09a4b8b861a6a5a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:17.863962 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899d6063c8f84936b09a4b8b861a6a5a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:17.881388 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1442/2848] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:17 2022] DELETE /identity/v3/users/899d6063c8f84936b09a4b8b861a6a5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:17.886469 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:17.886956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:17.887054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:17.905618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:17.906805 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:17.968173 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1407/2849] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:17.978129 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:17.979653 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:18.038514 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a79765-e4b5-4ca2-a6ad-f928325fd3f9 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.042810 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.043460 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.043739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.044015 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.053374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.054851 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b73a-e20e-4156-90f3-781a0d96c4a6 service neutron] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.064350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1443/2850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 16:28:18.334248 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.335733 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:18.348919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf6592-4acb-443f-a855-b35e9d50f23a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.354651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.355558 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.355976 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.356257 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] PATH_INFO: `/v3/projects/1809ae9d3b4e42ba98be4300e8d20b5a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.357657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1809ae9d3b4e42ba98be4300e8d20b5a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.359724 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.410466 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1809ae9d3b4e42ba98be4300e8d20b5a', 'request_id': 'req-d5ba91ad-ed39-403f-b58f-36c27b5a107e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:18.417053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1809ae9d3b4e42ba98be4300e8d20b5a', 'request_id': 'req-d5ba91ad-ed39-403f-b58f-36c27b5a107e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:18.427433 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1809ae9d3b4e42ba98be4300e8d20b5a', 'request_id': 'req-d5ba91ad-ed39-403f-b58f-36c27b5a107e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:18.439378 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] The token cache is being invalidate because project 1809ae9d3b4e42ba98be4300e8d20b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:18.439688 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:18.440476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d5ba91ad-ed39-403f-b58f-36c27b5a107e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:18.442240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1408/2851] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:18 2022] DELETE /identity/v3/projects/1809ae9d3b4e42ba98be4300e8d20b5a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:18.448664 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.448954 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.449200 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.470833 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:18.472071 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:18.521584 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:18.536209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1444/2852] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:18.545273 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.545639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.545989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.568798 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:18.570410 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:18.587580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1409/2853] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:18.593893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.608156 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65239b-891a-4a93-a2e5-faeef3c35b2f None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.615870 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.616577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.616860 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.617131 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.617861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:28:18.618167 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.619775 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.632088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1445/2854] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:28:18.636781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.646516 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0844-1eb5-4e1e-a9b3-c33aaad616ab None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.652299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.653020 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.653302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.653596 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.654367 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.656281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.669889 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:18.684488 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1410/2855] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:18 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:18.690409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.707350 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1221-261b-4bad-8b76-c00bd9360a6e admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.773865 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.774555 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.774832 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.775092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.775784 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.777737 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.802739 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1446/2856] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:18 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:18.807159 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.818657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975be64-625d-4bf1-9559-5978361751a8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.824299 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.824993 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.825272 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.825545 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.826264 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.827912 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.839064 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1411/2857] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:18.843231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.854207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2cc3-b5ee-4c0c-9d55-67046bf03d47 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.860197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.860909 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.861190 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.861455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.862182 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.863843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38540d61-6338-4d04-907b-b26034ad1d7d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.874742 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1447/2858] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:18.879326 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:18.893106 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3924-70a5-4fe7-966f-8444795b1547 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:18.901702 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:18.902960 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.903374 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.903755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] PATH_INFO: `/v3/projects/ebe5ff410df1418eabb29ccdecea7240/users/df6f8338ab3f49e7a954b19bc4ebbf0c/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.921933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe5ff410df1418eabb29ccdecea7240, user_id=df6f8338ab3f49e7a954b19bc4ebbf0c, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:18.924632 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:18.940521 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1412/2859] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:18 2022] PUT /identity/v3/projects/ebe5ff410df1418eabb29ccdecea7240/users/df6f8338ab3f49e7a954b19bc4ebbf0c/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:18.945942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f738-9d1e-4a0b-b861-ceab39b7aeec None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:18.946231 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f738-9d1e-4a0b-b861-ceab39b7aeec None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:18.946627 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f738-9d1e-4a0b-b861-ceab39b7aeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:18.965461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-8cc7f738-9d1e-4a0b-b861-ceab39b7aeec None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:18.966681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-8cc7f738-9d1e-4a0b-b861-ceab39b7aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:19.042724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1448/2860] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:19.052831 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:19.054735 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:19.118600 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac64620-a3d9-4f8c-91d0-d2a8c9993d6a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:19.123119 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:19.123774 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:19.124174 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:19.124480 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:19.136331 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:19.137846 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:19.147937 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1413/2861] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:19.766198 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:19.766487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:19.766786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:19.795063 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] MFA Rules not processed for user `df6f8338ab3f49e7a954b19bc4ebbf0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:19.796283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:19.845573 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:19.864252 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1449/2862] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:19.868850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:19.878988 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f894f-2d91-4d99-b98a-7615acaa5849 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:19.883892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:19.884579 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:19.884868 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:19.885150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:19.885844 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:19.887922 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:19.917713 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1414/2863] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:19 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:19.921691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:19.932641 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ba43-3ee5-4603-978b-b3e70ce863e6 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:19.988320 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:19.989035 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:19.989315 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:19.989619 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] PATH_INFO: `/v3/users` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:19.990316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:19.992243 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:20.012165 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1450/2864] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:19 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:20.016311 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:20.026929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46caff3-631f-426b-95e3-e98f22b2c2fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:20.031711 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:20.032539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:20.032828 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:20.033109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:20.033837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:20.035437 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:20.046886 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1415/2865] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:20.050854 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:20.061264 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ecaa4-ad0c-4a19-9458-9346b23eb64b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:20.065972 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:20.066852 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:20.067133 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:20.067410 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] PATH_INFO: `/v3/projects/325f7fe519ff43268f80e1ccedfe7971/users/4adcfaef48b04b1a944a4ab0aeea776e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:20.082092 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325f7fe519ff43268f80e1ccedfe7971, user_id=4adcfaef48b04b1a944a4ab0aeea776e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:20.084885 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:20.099206 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1451/2866] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:20 2022] PUT /identity/v3/projects/325f7fe519ff43268f80e1ccedfe7971/users/4adcfaef48b04b1a944a4ab0aeea776e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:28:20.103408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:20.113822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d23ab5-59a1-43f4-9659-f3dd6420edf5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:20.171832 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:20.172399 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:20.172726 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:20.173019 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:20.173744 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:20.175350 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb0c54-a539-4046-be31-87d61c7859d8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:20.185460 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1416/2867] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:20.189986 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:20.203061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e197856-1ece-41a0-8039-265d10f37561 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:20.209419 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:20.210330 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:20.210614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:20.210893 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] PATH_INFO: `/v3/projects/325f7fe519ff43268f80e1ccedfe7971/users/4adcfaef48b04b1a944a4ab0aeea776e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:20.213138 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325f7fe519ff43268f80e1ccedfe7971, user_id=4adcfaef48b04b1a944a4ab0aeea776e, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:20.215830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:20.228286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1452/2868] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:20 2022] PUT /identity/v3/projects/325f7fe519ff43268f80e1ccedfe7971/users/4adcfaef48b04b1a944a4ab0aeea776e/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:20.858571 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:20.858879 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:20.859138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:20.887544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] MFA Rules not processed for user `4adcfaef48b04b1a944a4ab0aeea776e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:20.888842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:20.901598 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:20.959953 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1417/2869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:21.646797 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:21.649102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:21.723510 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba758e2-d78e-4425-8f53-019d3d1aaa22 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:21.729861 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:21.730726 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:21.731077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:21.731416 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:21.733286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:21.745148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:21.746869 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:21.757454 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1453/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:22.242933 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:22.310355 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a20678-3971-4228-bd89-e093a5ba6370 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:22.315006 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:22.315888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:22.316169 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:22.316438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] PATH_INFO: `/v3/users/df6f8338ab3f49e7a954b19bc4ebbf0c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:22.317704 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6f8338ab3f49e7a954b19bc4ebbf0c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:22.319629 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:22.365888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6f8338ab3f49e7a954b19bc4ebbf0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.366459 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6f8338ab3f49e7a954b19bc4ebbf0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.367048 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6f8338ab3f49e7a954b19bc4ebbf0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.374125 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6f8338ab3f49e7a954b19bc4ebbf0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.382590 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6f8338ab3f49e7a954b19bc4ebbf0c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.401246 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1418/2871] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:22 2022] DELETE /identity/v3/users/df6f8338ab3f49e7a954b19bc4ebbf0c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:22.584556 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:22.595782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d04bd-f364-47ac-9452-d038d3896c02 service placement] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:22.626874 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:22.661727 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:22.662594 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:22.662873 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:22.663150 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] PATH_INFO: `/v3/projects/ebe5ff410df1418eabb29ccdecea7240` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:22.664374 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe5ff410df1418eabb29ccdecea7240)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:22.666654 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:22.714027 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe5ff410df1418eabb29ccdecea7240', 'request_id': 'req-c12ecdbf-5085-4556-8342-3fca92894e9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.721153 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe5ff410df1418eabb29ccdecea7240', 'request_id': 'req-c12ecdbf-5085-4556-8342-3fca92894e9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.729359 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe5ff410df1418eabb29ccdecea7240', 'request_id': 'req-c12ecdbf-5085-4556-8342-3fca92894e9c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.744210 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] The token cache is being invalidate because project ebe5ff410df1418eabb29ccdecea7240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:22.744639 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.745266 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.746862 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1454/2872] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:22 2022] DELETE /identity/v3/projects/ebe5ff410df1418eabb29ccdecea7240 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:22.751207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:22.752785 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:22.766751 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1e0f-f111-436a-bd0c-e4da2ad538f5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:22.793920 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:22.827103 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:22.827986 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:22.828268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:22.828581 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] PATH_INFO: `/v3/users/4adcfaef48b04b1a944a4ab0aeea776e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:22.829791 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adcfaef48b04b1a944a4ab0aeea776e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:22.831717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:22.882838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adcfaef48b04b1a944a4ab0aeea776e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.883408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adcfaef48b04b1a944a4ab0aeea776e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.884044 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adcfaef48b04b1a944a4ab0aeea776e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.891483 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adcfaef48b04b1a944a4ab0aeea776e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.900939 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f089a447-b217-4161-9fa4-314bca36f399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adcfaef48b04b1a944a4ab0aeea776e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:22.918241 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1419/2873] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:22 2022] DELETE /identity/v3/users/4adcfaef48b04b1a944a4ab0aeea776e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:28:23.097461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.098955 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:23.111982 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecdbf-5085-4556-8342-3fca92894e9c admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.169148 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.169945 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.170230 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.170507 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] PATH_INFO: `/v3/projects/325f7fe519ff43268f80e1ccedfe7971` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.171706 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] RBAC: Authorizing `identity:delete_project(project_id=325f7fe519ff43268f80e1ccedfe7971)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.173665 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.219197 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325f7fe519ff43268f80e1ccedfe7971', 'request_id': 'req-bf61c264-271d-4f93-bbfd-57a53ae2044c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:23.225214 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325f7fe519ff43268f80e1ccedfe7971', 'request_id': 'req-bf61c264-271d-4f93-bbfd-57a53ae2044c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:23.230809 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325f7fe519ff43268f80e1ccedfe7971', 'request_id': 'req-bf61c264-271d-4f93-bbfd-57a53ae2044c'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:23.232487 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:23.246957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] The token cache is being invalidate because project 325f7fe519ff43268f80e1ccedfe7971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:23.247413 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:23.248031 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-bf61c264-271d-4f93-bbfd-57a53ae2044c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:23.249585 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1455/2874] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:23 2022] DELETE /identity/v3/projects/325f7fe519ff43268f80e1ccedfe7971 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:23.254714 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.255218 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.255324 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.273963 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:23.275194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:23.346546 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1420/2875] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:23.354693 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.354998 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.355268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.375353 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:23.376642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:23.385782 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1456/2876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:23.390127 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.400645 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b222-d45c-4471-94c3-13c5d8f338c1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.406095 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.406756 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.407035 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.407308 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.408034 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:28:23.408332 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.409965 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.422270 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1421/2877] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 16:28:23.426536 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.436147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf544bd-acbf-4534-bd44-d4576dbf4838 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.441309 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.441959 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.442246 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.442642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.443316 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.445280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.479789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1457/2878] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 16:28:23.481196 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.491822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af219b0-5892-4bdb-8233-72cb6ccabc71 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.526094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:23.554267 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.554938 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.555225 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.555489 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.556181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.558154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.581773 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1422/2879] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/users => generated 305 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:23.586162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.596812 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664f02-816d-45ad-94af-aa1b02531775 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.602291 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.603143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.603509 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.603791 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.604691 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.606620 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.617723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1458/2880] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 16:28:23.621727 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.632204 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca99a7b-f673-451b-87cb-c57efee118f3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.637548 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.638207 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.638490 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.638766 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.639494 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.641134 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919031-7c3e-4022-a00b-ce3943aa8eb7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.651436 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1423/2881] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:23.655566 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.665934 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919bea-80e3-45d6-8965-09b9370f569d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.671286 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.672199 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.672552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.672786 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] PATH_INFO: `/v3/projects/dda96b7c652147098040403ffc2970fc/users/e5b6dabf74bf4e199e2a91f4a355078e/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.687788 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda96b7c652147098040403ffc2970fc, user_id=e5b6dabf74bf4e199e2a91f4a355078e, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.690475 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.706147 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1459/2882] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:23 2022] PUT /identity/v3/projects/dda96b7c652147098040403ffc2970fc/users/e5b6dabf74bf4e199e2a91f4a355078e/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:23.717734 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.718023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.718296 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.744792 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] MFA Rules not processed for user `e5b6dabf74bf4e199e2a91f4a355078e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:23.746016 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:23.814808 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1424/2883] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:23.821821 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.890385 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01b06-5170-4fa2-93d2-9533b0281145 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:23.895904 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:23.896647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:23.896935 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:23.897212 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:23.897898 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:23.899843 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:23.932602 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1460/2884] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:23.936896 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:23.947818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dbdf0-8652-49c2-89fd-461603a823e1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.009288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.009970 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.010259 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.010539 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.011228 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.013200 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.034213 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1425/2885] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:23 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:24.038373 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.049541 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460430-dc6c-4f40-ac14-9df7fb32aa21 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.055312 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.055980 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.056257 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.056577 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.057306 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.058957 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.070002 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1461/2886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:24.074349 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.085493 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e916a-9a7b-4223-bbaa-3b75519227fc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.090585 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.091476 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.091753 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.092037 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] PATH_INFO: `/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc/users/f2469c9a63a54470b902fb67018c2e8c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.107054 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb225e2bb1a4f35afb4ad900ae1d6bc, user_id=f2469c9a63a54470b902fb67018c2e8c, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.109762 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.124419 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1426/2887] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:24 2022] PUT /identity/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc/users/f2469c9a63a54470b902fb67018c2e8c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:24.128421 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.138785 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed776108-2295-410e-8d49-d4e73ef68f2d admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.199537 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.200126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.200424 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.200718 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.201440 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.203046 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235d16-42e2-409b-a6e9-e3c2ef68286d admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.205178 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:24.215661 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1462/2888] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:24.220245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.234456 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e466-a597-4583-835e-c651e7256e1b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.243271 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.244580 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.244948 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.245302 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] PATH_INFO: `/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc/users/f2469c9a63a54470b902fb67018c2e8c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.248797 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb225e2bb1a4f35afb4ad900ae1d6bc, user_id=f2469c9a63a54470b902fb67018c2e8c, role_id=e7cdf09f4cf04ef8b871ffd9d2716cf6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.252942 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.257101 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:24.266052 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1427/2889] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:24 2022] PUT /identity/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc/users/f2469c9a63a54470b902fb67018c2e8c/roles/e7cdf09f4cf04ef8b871ffd9d2716cf6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:24.276442 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.276765 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.277043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.304825 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] MFA Rules not processed for user `f2469c9a63a54470b902fb67018c2e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:24.306033 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:24.381409 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1463/2890] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:24.397227 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.399837 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:24.469240 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8823f9-e616-4353-97dc-5abe501de63e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.474129 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.474842 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.475124 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.475408 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.486150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.487717 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.497947 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1428/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:24.663889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:24.675729 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27866b0a-35e7-4533-a55f-147bfda4d19e None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:24.680625 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:24.681276 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:24.681559 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:24.681834 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:24.771102 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:24.772723 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256c537-ac9a-42ca-9b98-25e6eead4ec1 service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:24.782270 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1464/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:30.090275 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:30.154377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf91b-32c8-4938-b266-c5b0625c7972 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:30.159631 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:30.160544 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:30.160827 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:30.161088 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] PATH_INFO: `/v3/users/e5b6dabf74bf4e199e2a91f4a355078e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:30.162319 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b6dabf74bf4e199e2a91f4a355078e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:30.164253 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:30.217138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b6dabf74bf4e199e2a91f4a355078e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.217885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b6dabf74bf4e199e2a91f4a355078e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.218737 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b6dabf74bf4e199e2a91f4a355078e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.225455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b6dabf74bf4e199e2a91f4a355078e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.234182 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b6dabf74bf4e199e2a91f4a355078e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.251755 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1429/2893] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:30 2022] DELETE /identity/v3/users/e5b6dabf74bf4e199e2a91f4a355078e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:30.256375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:30.256837 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:30.256992 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:30.274772 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:30.276030 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:30.336271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1465/2894] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:30.346211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:30.347801 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:30.368967 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:30.410443 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c55158-a224-496c-927d-01dcb683bd64 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:30.415611 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:30.416268 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:30.416589 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:30.416861 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:30.427651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:30.429138 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:30.439340 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1430/2895] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:30.711054 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:30.712681 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:30.725824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d9bf1-1bce-4a55-a508-896129246f4b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:30.731245 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:30.732170 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:30.732476 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:30.732736 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] PATH_INFO: `/v3/projects/dda96b7c652147098040403ffc2970fc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:30.733983 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda96b7c652147098040403ffc2970fc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:30.735976 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:30.756671 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=100 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:30.798889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda96b7c652147098040403ffc2970fc', 'request_id': 'req-dd14e36d-6338-4003-a99d-69243891f2e4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.804984 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda96b7c652147098040403ffc2970fc', 'request_id': 'req-dd14e36d-6338-4003-a99d-69243891f2e4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.810985 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda96b7c652147098040403ffc2970fc', 'request_id': 'req-dd14e36d-6338-4003-a99d-69243891f2e4'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.824115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] The token cache is being invalidate because project dda96b7c652147098040403ffc2970fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:30.824406 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.825111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.826725 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1466/2896] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:30 2022] DELETE /identity/v3/projects/dda96b7c652147098040403ffc2970fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:30.831009 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:30.841076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a614c-3bbe-4ff4-811f-ecceab8a37f2 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:30.899194 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:30.900079 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:30.900363 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:30.900673 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] PATH_INFO: `/v3/users/f2469c9a63a54470b902fb67018c2e8c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:30.901915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2469c9a63a54470b902fb67018c2e8c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:30.903892 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:30.954956 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2469c9a63a54470b902fb67018c2e8c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.955591 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2469c9a63a54470b902fb67018c2e8c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.956185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2469c9a63a54470b902fb67018c2e8c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.962911 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2469c9a63a54470b902fb67018c2e8c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.971288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-67b5bb1b-8c24-4f97-975f-86b4ea9fee5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2469c9a63a54470b902fb67018c2e8c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:30.991885 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1431/2897] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:30 2022] DELETE /identity/v3/users/f2469c9a63a54470b902fb67018c2e8c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:31.261553 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.263105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:31.276632 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e36d-6338-4003-a99d-69243891f2e4 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.343967 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.345405 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.345770 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.346160 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] PATH_INFO: `/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.348115 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb225e2bb1a4f35afb4ad900ae1d6bc)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.351207 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.399938 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb225e2bb1a4f35afb4ad900ae1d6bc', 'request_id': 'req-2cce62ce-1ff7-4a99-9dbb-c9070b571562'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:31.406162 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb225e2bb1a4f35afb4ad900ae1d6bc', 'request_id': 'req-2cce62ce-1ff7-4a99-9dbb-c9070b571562'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:31.412348 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb225e2bb1a4f35afb4ad900ae1d6bc', 'request_id': 'req-2cce62ce-1ff7-4a99-9dbb-c9070b571562'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:31.428626 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] The token cache is being invalidate because project 2fb225e2bb1a4f35afb4ad900ae1d6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:31.428892 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:31.429589 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2cce62ce-1ff7-4a99-9dbb-c9070b571562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:31.431260 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1467/2898] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:31 2022] DELETE /identity/v3/projects/2fb225e2bb1a4f35afb4ad900ae1d6bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:31.436382 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.436929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.436929 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.455915 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:31.457167 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:31.492979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:31.520795 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1432/2899] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:31.529994 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.530289 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.530575 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.552730 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:31.553997 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:31.562808 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1468/2900] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:31.567439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.577512 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e695-ae34-4f9e-a843-82bb07ae1d3e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.582435 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.583102 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.583377 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.583654 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.584384 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:28:31.584720 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.586329 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.598391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1433/2901] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:28:31.602621 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.612161 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec158fd-b5f3-4338-b8a8-35e7b96a8c2b None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.617233 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.617889 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.618166 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.618438 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.619124 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.621066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.647558 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1469/2902] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:31 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:31.651781 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.662281 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4bf27-4b81-4374-9cd6-640fa343e8b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.721618 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.722288 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.722575 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.722853 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.723533 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.725515 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.746165 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1434/2903] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:31 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:31.750375 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.761215 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daceb6-86aa-4844-801f-5f585568f157 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.766461 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.767130 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.767411 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.767687 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.768422 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.770066 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.771521 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:31.782069 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1470/2904] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:31.786310 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.796817 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10442b3-441b-47c9-a99e-25f8a0bbabab admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.801625 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.802287 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.802573 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.802850 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.803576 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.805239 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992466f-671b-4b73-982c-406e8d109ba4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.815274 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1435/2905] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:31.819552 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:31.829455 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003b5-561f-49e1-a654-9a32cda7f652 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:31.834450 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:31.835369 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.835652 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.835928 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] PATH_INFO: `/v3/projects/9f2cf751162d43498197ed03e139020c/users/2fce70c6807f4b98a5e3aba6d68979e0/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.851037 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2cf751162d43498197ed03e139020c, user_id=2fce70c6807f4b98a5e3aba6d68979e0, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:31.853745 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:31.868522 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1471/2906] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:31 2022] PUT /identity/v3/projects/9f2cf751162d43498197ed03e139020c/users/2fce70c6807f4b98a5e3aba6d68979e0/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:31.936540 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e856-3985-4387-9777-54d18789a153 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:31.936822 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e856-3985-4387-9777-54d18789a153 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:31.937139 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e856-3985-4387-9777-54d18789a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:31.973471 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c005e856-3985-4387-9777-54d18789a153 None None] MFA Rules not processed for user `2fce70c6807f4b98a5e3aba6d68979e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:31.974706 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c005e856-3985-4387-9777-54d18789a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:32.044187 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1436/2907] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:32.055814 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:32.057744 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:32.138872 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af28e3-2c82-44b3-b62c-9607bc282854 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:32.142715 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1165a25eb4467af1500b2c6199e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:32.143364 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:32.143647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:32.143923 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:32.152284 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:32.153824 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88968bc-fbc6-42d8-a180-aebae6e053fc service glance] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:32.162548 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1472/2908] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:42.041256 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:42.158753 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:49.841150 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e856-3985-4387-9777-54d18789a153 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:49.904668 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e856-3985-4387-9777-54d18789a153 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:49.910183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:49.911093 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:49.911372 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:49.911648 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] PATH_INFO: `/v3/users/2fce70c6807f4b98a5e3aba6d68979e0` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:49.912888 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fce70c6807f4b98a5e3aba6d68979e0)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:49.915181 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:49.965961 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fce70c6807f4b98a5e3aba6d68979e0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:49.966659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fce70c6807f4b98a5e3aba6d68979e0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:49.967298 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fce70c6807f4b98a5e3aba6d68979e0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:49.974208 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fce70c6807f4b98a5e3aba6d68979e0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:49.983391 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fce70c6807f4b98a5e3aba6d68979e0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.001438 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1437/2909] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:49 2022] DELETE /identity/v3/users/2fce70c6807f4b98a5e3aba6d68979e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:50.006126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.006649 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.006876 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.025403 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:50.026638 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:50.085528 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1473/2910] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:50.095685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.098076 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:50.161053 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05a52-423b-475e-acef-323a48b325fb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.165746 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.166507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.166876 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.167162 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.176872 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.178322 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e6e77-98a7-4ffd-9315-38667b5fec2e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.188109 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1438/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:50.465963 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.467576 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:50.480947 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb2b5-cf09-4ad4-8740-9f55785dff78 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.486526 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.487417 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.487697 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.487971 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] PATH_INFO: `/v3/projects/9f2cf751162d43498197ed03e139020c` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.489890 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2cf751162d43498197ed03e139020c)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.491431 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.539660 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2cf751162d43498197ed03e139020c', 'request_id': 'req-6e9852fb-9dc6-499e-8144-f708d9d2a500'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.545921 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2cf751162d43498197ed03e139020c', 'request_id': 'req-6e9852fb-9dc6-499e-8144-f708d9d2a500'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.551404 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2cf751162d43498197ed03e139020c', 'request_id': 'req-6e9852fb-9dc6-499e-8144-f708d9d2a500'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.566434 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] The token cache is being invalidate because project 9f2cf751162d43498197ed03e139020c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:50.566724 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.567428 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-6e9852fb-9dc6-499e-8144-f708d9d2a500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:50.569143 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1474/2912] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:50 2022] DELETE /identity/v3/projects/9f2cf751162d43498197ed03e139020c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:50.574276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.574560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.574834 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.593930 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:50.595022 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:50.612245 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:50.655603 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1439/2913] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 16:28:50.663647 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.663939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.664603 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.684379 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:50.685644 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:50.694280 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1475/2914] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:50.698693 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.708917 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f038-b5b4-479e-80d4-0fbfa7edf699 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.714685 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.715333 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.715621 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.715897 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.716679 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 16:28:50.716989 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.718659 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.730703 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1440/2915] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 5 16:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 16:28:50.735112 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.744378 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acbce8-05d6-4963-b5ab-856285594666 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.749550 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.750202 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.750481 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.750761 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.751457 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.753453 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.781105 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1476/2916] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 5 16:28:50 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:50.785339 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.796157 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e4e1-4c6d-4eeb-a44f-53cb94d82aa0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.854357 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.854995 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.855214 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.855496 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.856185 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.858154 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.880910 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1441/2917] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 5 16:28:50 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 16:28:50.885108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.895683 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864f668-fe19-4e1f-bf4e-ae34c0d1b3d7 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.900866 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.901532 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.901830 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.902103 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] PATH_INFO: `/v3/roles` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.902827 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.904477 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.915110 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1477/2918] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:50.920276 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.931487 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37324d8-0329-4d90-a376-9f9bfba25804 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.936220 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.936927 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.937205 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.937478 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.938206 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.939796 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ce605-6512-4267-bbe4-9e774035697b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:50.950475 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1442/2919] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 5 16:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 16:28:50.955978 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:50.966137 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f2a-c255-4f99-af7b-143871ce928b admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:50.971111 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:50.971991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:50.972271 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:50.972554 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] PATH_INFO: `/v3/projects/2afe3db3f588416985a15fe1b2c5be08/users/1ec7159b071e4170870bef4f073c7c23/roles/440da6136d59483baa79a4c88adb52a0` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:50.988345 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afe3db3f588416985a15fe1b2c5be08, user_id=1ec7159b071e4170870bef4f073c7c23, role_id=440da6136d59483baa79a4c88adb52a0)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:50.991061 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:51.007642 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1478/2920] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 5 16:28:50 2022] PUT /identity/v3/projects/2afe3db3f588416985a15fe1b2c5be08/users/1ec7159b071e4170870bef4f073c7c23/roles/440da6136d59483baa79a4c88adb52a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 16:28:51.019815 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:51.020126 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:51.020439 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:51.051742 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] MFA Rules not processed for user `1ec7159b071e4170870bef4f073c7c23`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:51.052973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:51.124701 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1443/2921] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:51.136074 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:51.137939 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:51.160077 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:51.197463 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e25d-2c1d-4118-90dc-f54368545d93 admin admin] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:51.201551 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7854f2cdbc443eab856854d0a1c8bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:51.202209 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] REQUEST_METHOD: `GET` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:51.202486 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:51.202767 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:51.211557 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:51.213043 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2102-8b07-4c75-89cc-3a658b2cb85e service cinder] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:51.222108 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1479/2922] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:56.264838 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:56.285428 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:28:56.332987 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573498-9abe-4050-81f0-e8a36d820073 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:56.338211 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:56.339131 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:56.339455 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:56.339730 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] PATH_INFO: `/v3/users/1ec7159b071e4170870bef4f073c7c23` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:56.341023 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec7159b071e4170870bef4f073c7c23)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:56.342979 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:56.391639 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec7159b071e4170870bef4f073c7c23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.392289 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec7159b071e4170870bef4f073c7c23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.392919 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec7159b071e4170870bef4f073c7c23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.400223 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec7159b071e4170870bef4f073c7c23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.407657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec7159b071e4170870bef4f073c7c23'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.426025 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1444/2923] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 5 16:28:56 2022] DELETE /identity/v3/users/1ec7159b071e4170870bef4f073c7c23 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:28:56.430614 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] REQUEST_METHOD: `POST` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:56.431126 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:56.431237 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:56.453877 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.auth.core [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] MFA Rules not processed for user `43433f69b2c244e5a234c2286e9ce5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 16:28:56.455283 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:56.520789 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1480/2924] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 5 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 16:28:56.530997 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:56.532743 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:56.593445 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3b11-adce-435a-880d-5ce3b0fdc733 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:56.597887 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55aa833284d4f73932873f884f1bb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:56.598534 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:56.598818 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:56.599094 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:56.609183 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:56.610652 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:56.620624 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1445/2925] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:28:56.898858 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] Authenticating user token {{(pid=80424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:28:56.900402 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.fernet_utils [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:28:56.913028 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eafaf1-639e-4acb-80f2-ad062f2b3118 None None] Validating token access rules against request {{(pid=80424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:28:56.918630 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43433f69b2c244e5a234c2286e9ce5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd319fa168ab84848b7e88269fc1c486a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:28:56.919508 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:28:56.919790 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:28:56.920067 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] PATH_INFO: `/v3/projects/2afe3db3f588416985a15fe1b2c5be08` {{(pid=80424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:28:56.928969 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afe3db3f588416985a15fe1b2c5be08)` {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:28:56.930942 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] RBAC: Authorization granted {{(pid=80424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:28:56.986516 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afe3db3f588416985a15fe1b2c5be08', 'request_id': 'req-2316daf8-e265-4ac8-9ba8-46362329f48a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.992484 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afe3db3f588416985a15fe1b2c5be08', 'request_id': 'req-2316daf8-e265-4ac8-9ba8-46362329f48a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:56.999595 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afe3db3f588416985a15fe1b2c5be08', 'request_id': 'req-2316daf8-e265-4ac8-9ba8-46362329f48a'} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:57.012803 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] The token cache is being invalidate because project 2afe3db3f588416985a15fe1b2c5be08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 16:28:57.013088 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:57.013700 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG keystone.notifications [None req-2316daf8-e265-4ac8-9ba8-46362329f48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 16:28:57.015268 dv-cinder-848759-1-smb devstack@keystone.service[80424]: [pid: 80424|app: 0|req: 1481/2926] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 5 16:28:56 2022] DELETE /identity/v3/projects/2afe3db3f588416985a15fe1b2c5be08 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 16:29:06.616507 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:29:07.009991 dv-cinder-848759-1-smb devstack@keystone.service[80424]: DEBUG dbcounter [-] [80424] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:31:48.199651 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 16:31:48.201973 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:31:48.274839 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3ea3-67d1-46ac-8d41-d745e2c79c51 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 16:31:48.359560 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cfb966c12ea4f60a7682649c7a5cfee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09209f66de74ba69bbe6f3df5d69610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 16:31:48.360392 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 16:31:48.360715 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 16:31:48.361111 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 16:31:48.363151 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 16:31:48.375380 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 16:31:48.377007 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d02d7b-7518-4156-ba99-42bf2ee5cb10 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 16:31:48.387657 dv-cinder-848759-1-smb devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1446/2927] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 5 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 16:31:58.383209 dv-cinder-848759-1-smb devstack@keystone.service[80423]: DEBUG dbcounter [-] [80423] Writing DB stats keystone:SELECT=58 {{(pid=80423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}